2024-02-27 02:54:37,401 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-02-27 02:54:37,634 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2 2024-02-27 02:54:37,649 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-02-27 02:54:37,649 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/cluster_e2bc6166-dc27-5c3d-9875-4bd36d5db790, deleteOnExit=true 2024-02-27 02:54:37,650 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-02-27 02:54:37,650 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/test.cache.data in system properties and HBase conf 2024-02-27 02:54:37,650 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/hadoop.tmp.dir in system properties and HBase conf 2024-02-27 02:54:37,651 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/hadoop.log.dir in system properties and HBase conf 2024-02-27 02:54:37,651 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/mapreduce.cluster.local.dir in system properties and HBase conf 2024-02-27 02:54:37,652 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-02-27 02:54:37,652 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-02-27 02:54:37,771 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-02-27 02:54:38,200 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-02-27 02:54:38,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-02-27 02:54:38,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-02-27 02:54:38,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-02-27 02:54:38,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-02-27 02:54:38,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-02-27 02:54:38,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-02-27 02:54:38,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-02-27 02:54:38,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/dfs.journalnode.edits.dir in system properties and HBase conf 2024-02-27 02:54:38,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-02-27 02:54:38,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/nfs.dump.dir in system properties and HBase conf 2024-02-27 02:54:38,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/java.io.tmpdir in system properties and HBase conf 2024-02-27 02:54:38,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/dfs.journalnode.edits.dir in system properties and HBase conf 2024-02-27 02:54:38,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-02-27 02:54:38,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-02-27 02:54:38,734 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-02-27 02:54:38,739 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-02-27 02:54:39,025 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-02-27 02:54:39,203 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-02-27 02:54:39,222 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-27 02:54:39,258 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-02-27 02:54:39,291 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/java.io.tmpdir/Jetty_localhost_42115_hdfs____8ggy9t/webapp 2024-02-27 02:54:39,434 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42115 2024-02-27 02:54:39,444 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-02-27 02:54:39,445 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-02-27 02:54:39,931 WARN [Listener at localhost/35999] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-27 02:54:40,016 WARN [Listener at localhost/35999] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-02-27 02:54:40,034 WARN [Listener at localhost/35999] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-27 02:54:40,042 INFO [Listener at localhost/35999] log.Slf4jLog(67): jetty-6.1.26 2024-02-27 02:54:40,047 INFO [Listener at localhost/35999] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/java.io.tmpdir/Jetty_localhost_41081_datanode____3ziu7n/webapp 2024-02-27 02:54:40,143 INFO [Listener at localhost/35999] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41081 2024-02-27 02:54:40,476 WARN [Listener at localhost/37579] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-27 02:54:40,500 WARN [Listener at localhost/37579] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-02-27 02:54:40,505 WARN [Listener at localhost/37579] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-27 02:54:40,508 INFO [Listener at localhost/37579] log.Slf4jLog(67): jetty-6.1.26 2024-02-27 02:54:40,517 INFO [Listener at localhost/37579] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/java.io.tmpdir/Jetty_localhost_38875_datanode____.v5f6yw/webapp 2024-02-27 02:54:40,632 INFO [Listener at localhost/37579] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38875 2024-02-27 02:54:40,641 WARN [Listener at localhost/35297] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-27 02:54:40,943 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf9e62a9bdcd2cf79: Processing first storage report for DS-6e5333b8-4087-4d2f-b759-77f4ef659dae from datanode ff83790c-0884-4430-bbc1-8b4c54170aaf 2024-02-27 02:54:40,945 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf9e62a9bdcd2cf79: from storage DS-6e5333b8-4087-4d2f-b759-77f4ef659dae node DatanodeRegistration(127.0.0.1:46829, datanodeUuid=ff83790c-0884-4430-bbc1-8b4c54170aaf, infoPort=35937, infoSecurePort=0, ipcPort=37579, storageInfo=lv=-57;cid=testClusterID;nsid=923922778;c=1709002478816), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-02-27 02:54:40,945 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x419d60d04a56ba50: Processing first storage report for DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1 from datanode 5e18fb73-57d7-48a9-97e1-fb8da27a587a 2024-02-27 02:54:40,945 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x419d60d04a56ba50: from storage DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1 node DatanodeRegistration(127.0.0.1:36911, datanodeUuid=5e18fb73-57d7-48a9-97e1-fb8da27a587a, infoPort=39805, infoSecurePort=0, ipcPort=35297, storageInfo=lv=-57;cid=testClusterID;nsid=923922778;c=1709002478816), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-02-27 02:54:40,945 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf9e62a9bdcd2cf79: Processing first storage report for DS-d8e279a1-d913-4b09-8f46-540b1ceef565 from datanode ff83790c-0884-4430-bbc1-8b4c54170aaf 2024-02-27 02:54:40,946 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf9e62a9bdcd2cf79: from storage DS-d8e279a1-d913-4b09-8f46-540b1ceef565 node DatanodeRegistration(127.0.0.1:46829, datanodeUuid=ff83790c-0884-4430-bbc1-8b4c54170aaf, infoPort=35937, infoSecurePort=0, ipcPort=37579, storageInfo=lv=-57;cid=testClusterID;nsid=923922778;c=1709002478816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-27 02:54:40,946 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x419d60d04a56ba50: Processing first storage report for DS-58b5c451-bb50-4fa7-8c16-56d2cf7925ed from datanode 5e18fb73-57d7-48a9-97e1-fb8da27a587a 2024-02-27 02:54:40,946 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x419d60d04a56ba50: from storage DS-58b5c451-bb50-4fa7-8c16-56d2cf7925ed node DatanodeRegistration(127.0.0.1:36911, datanodeUuid=5e18fb73-57d7-48a9-97e1-fb8da27a587a, infoPort=39805, infoSecurePort=0, ipcPort=35297, storageInfo=lv=-57;cid=testClusterID;nsid=923922778;c=1709002478816), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-27 02:54:41,049 DEBUG [Listener at localhost/35297] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2 2024-02-27 02:54:41,173 INFO [Listener at localhost/35297] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/cluster_e2bc6166-dc27-5c3d-9875-4bd36d5db790/zookeeper_0, clientPort=63173, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/cluster_e2bc6166-dc27-5c3d-9875-4bd36d5db790/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/cluster_e2bc6166-dc27-5c3d-9875-4bd36d5db790/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-02-27 02:54:41,190 INFO [Listener at localhost/35297] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63173 2024-02-27 02:54:41,202 INFO [Listener at localhost/35297] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:41,205 INFO [Listener at localhost/35297] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:41,898 INFO [Listener at localhost/35297] util.FSUtils(471): Created version file at hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb with version=8 2024-02-27 02:54:41,899 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/hbase-staging 2024-02-27 02:54:42,238 INFO [Listener at localhost/35297] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-02-27 02:54:42,749 INFO [Listener at localhost/35297] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-02-27 02:54:42,783 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:42,784 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:42,784 INFO [Listener at localhost/35297] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-27 02:54:42,784 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:42,785 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-27 02:54:42,934 INFO [Listener at localhost/35297] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-02-27 02:54:43,010 DEBUG [Listener at localhost/35297] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-02-27 02:54:43,108 INFO [Listener at localhost/35297] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42961 2024-02-27 02:54:43,118 INFO [Listener at localhost/35297] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:43,120 INFO [Listener at localhost/35297] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:43,141 INFO [Listener at localhost/35297] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42961 connecting to ZooKeeper ensemble=127.0.0.1:63173 2024-02-27 02:54:43,185 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:429610x0, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-27 02:54:43,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42961-0x1000ddd257b0000 connected 2024-02-27 02:54:43,220 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-27 02:54:43,221 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 02:54:43,224 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-27 02:54:43,233 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42961 2024-02-27 02:54:43,233 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42961 2024-02-27 02:54:43,234 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42961 2024-02-27 02:54:43,234 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42961 2024-02-27 02:54:43,234 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42961 2024-02-27 02:54:43,241 INFO [Listener at localhost/35297] master.HMaster(445): hbase.rootdir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb, hbase.cluster.distributed=false 2024-02-27 02:54:43,315 INFO [Listener at localhost/35297] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-02-27 02:54:43,316 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:43,316 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:43,316 INFO [Listener at localhost/35297] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-27 02:54:43,316 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:43,316 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-27 02:54:43,322 INFO [Listener at localhost/35297] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-02-27 02:54:43,326 INFO [Listener at localhost/35297] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40779 2024-02-27 02:54:43,328 INFO [Listener at localhost/35297] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-02-27 02:54:43,335 DEBUG [Listener at localhost/35297] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-02-27 02:54:43,337 INFO [Listener at localhost/35297] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:43,339 INFO [Listener at localhost/35297] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:43,342 INFO [Listener at localhost/35297] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40779 connecting to ZooKeeper ensemble=127.0.0.1:63173 2024-02-27 02:54:43,346 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:407790x0, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-27 02:54:43,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40779-0x1000ddd257b0001 connected 2024-02-27 02:54:43,348 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-27 02:54:43,350 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 02:54:43,351 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-27 02:54:43,351 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40779 2024-02-27 02:54:43,351 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40779 2024-02-27 02:54:43,352 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40779 2024-02-27 02:54:43,353 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40779 2024-02-27 02:54:43,353 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40779 2024-02-27 02:54:43,366 INFO [Listener at localhost/35297] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-02-27 02:54:43,366 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:43,367 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:43,367 INFO [Listener at localhost/35297] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-27 02:54:43,367 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 02:54:43,367 INFO [Listener at localhost/35297] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-27 02:54:43,367 INFO [Listener at localhost/35297] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-02-27 02:54:43,369 INFO [Listener at localhost/35297] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45281 2024-02-27 02:54:43,369 INFO [Listener at localhost/35297] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-02-27 02:54:43,371 DEBUG [Listener at localhost/35297] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-02-27 02:54:43,371 INFO [Listener at localhost/35297] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:43,373 INFO [Listener at localhost/35297] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:43,376 INFO [Listener at localhost/35297] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45281 connecting to ZooKeeper ensemble=127.0.0.1:63173 2024-02-27 02:54:43,381 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:452810x0, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-27 02:54:43,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45281-0x1000ddd257b0002 connected 2024-02-27 02:54:43,382 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-27 02:54:43,383 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 02:54:43,384 DEBUG [Listener at localhost/35297] zookeeper.ZKUtil(165): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-27 02:54:43,385 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45281 2024-02-27 02:54:43,385 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45281 2024-02-27 02:54:43,386 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45281 2024-02-27 02:54:43,389 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45281 2024-02-27 02:54:43,389 DEBUG [Listener at localhost/35297] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45281 2024-02-27 02:54:43,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:54:43,402 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-02-27 02:54:43,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:54:43,426 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-27 02:54:43,426 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-27 02:54:43,426 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-27 02:54:43,426 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:54:43,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-02-27 02:54:43,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42961,1709002482057 from backup master directory 2024-02-27 02:54:43,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-02-27 02:54:43,432 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:54:43,432 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-02-27 02:54:43,433 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-27 02:54:43,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:54:43,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-02-27 02:54:43,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-02-27 02:54:43,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/hbase.id with ID: 881a08ff-0dff-4f0d-8cb8-77099ad4584d 2024-02-27 02:54:43,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 02:54:43,589 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:54:43,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4bac309a to 127.0.0.1:63173 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-27 02:54:43,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49562802, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-27 02:54:43,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 02:54:43,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-02-27 02:54:43,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-02-27 02:54:43,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-02-27 02:54:43,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-02-27 02:54:43,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-02-27 02:54:43,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-27 02:54:43,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store-tmp 2024-02-27 02:54:43,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:43,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-02-27 02:54:43,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 02:54:43,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 02:54:43,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-02-27 02:54:43,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 02:54:43,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 02:54:43,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-27 02:54:43,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/WALs/jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:54:43,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42961%2C1709002482057, suffix=, logDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/WALs/jenkins-hbase4.apache.org,42961,1709002482057, archiveDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/oldWALs, maxLogs=10 2024-02-27 02:54:43,880 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46829,DS-6e5333b8-4087-4d2f-b759-77f4ef659dae,DISK] 2024-02-27 02:54:43,880 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36911,DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1,DISK] 2024-02-27 02:54:43,888 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-02-27 02:54:43,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/WALs/jenkins-hbase4.apache.org,42961,1709002482057/jenkins-hbase4.apache.org%2C42961%2C1709002482057.1709002483830 2024-02-27 02:54:43,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46829,DS-6e5333b8-4087-4d2f-b759-77f4ef659dae,DISK], DatanodeInfoWithStorage[127.0.0.1:36911,DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1,DISK]] 2024-02-27 02:54:43,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-02-27 02:54:43,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:43,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-02-27 02:54:43,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-02-27 02:54:44,031 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-02-27 02:54:44,039 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-02-27 02:54:44,063 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-02-27 02:54:44,075 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:44,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-02-27 02:54:44,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-02-27 02:54:44,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-02-27 02:54:44,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:44,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66372731, jitterRate=-0.010969236493110657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 02:54:44,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-27 02:54:44,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-02-27 02:54:44,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-02-27 02:54:44,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-02-27 02:54:44,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-02-27 02:54:44,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-02-27 02:54:44,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 33 msec 2024-02-27 02:54:44,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-02-27 02:54:44,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-02-27 02:54:44,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-02-27 02:54:44,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-02-27 02:54:44,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-02-27 02:54:44,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-02-27 02:54:44,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-02-27 02:54:44,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-02-27 02:54:44,245 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:54:44,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-02-27 02:54:44,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-02-27 02:54:44,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-02-27 02:54:44,269 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-27 02:54:44,269 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-27 02:54:44,269 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-27 02:54:44,269 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:54:44,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,42961,1709002482057, sessionid=0x1000ddd257b0000, setting cluster-up flag (Was=false) 2024-02-27 02:54:44,288 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:54:44,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-02-27 02:54:44,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:54:44,301 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:54:44,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-02-27 02:54:44,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:54:44,312 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.hbase-snapshot/.tmp 2024-02-27 02:54:44,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-02-27 02:54:44,394 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(954): ClusterId : 881a08ff-0dff-4f0d-8cb8-77099ad4584d 2024-02-27 02:54:44,394 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(954): ClusterId : 881a08ff-0dff-4f0d-8cb8-77099ad4584d 2024-02-27 02:54:44,401 DEBUG [RS:0;jenkins-hbase4:40779] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-02-27 02:54:44,401 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-02-27 02:54:44,407 DEBUG [RS:0;jenkins-hbase4:40779] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-02-27 02:54:44,407 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-02-27 02:54:44,408 DEBUG [RS:0;jenkins-hbase4:40779] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-02-27 02:54:44,408 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-02-27 02:54:44,412 DEBUG [RS:0;jenkins-hbase4:40779] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-02-27 02:54:44,413 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-02-27 02:54:44,414 DEBUG [RS:0;jenkins-hbase4:40779] zookeeper.ReadOnlyZKClient(139): Connect 0x7d883c93 to 127.0.0.1:63173 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-27 02:54:44,416 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ReadOnlyZKClient(139): Connect 0x2f7ba3fa to 127.0.0.1:63173 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-27 02:54:44,435 DEBUG [RS:0;jenkins-hbase4:40779] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@734fcd52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-27 02:54:44,435 DEBUG [RS:1;jenkins-hbase4:45281] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21bc4865, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-27 02:54:44,436 DEBUG [RS:0;jenkins-hbase4:40779] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@777057e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-27 02:54:44,436 DEBUG [RS:1;jenkins-hbase4:45281] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2583c88a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-27 02:54:44,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-02-27 02:54:44,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-27 02:54:44,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-27 02:54:44,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-27 02:54:44,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-27 02:54:44,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-02-27 02:54:44,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-27 02:54:44,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1709002514455 2024-02-27 02:54:44,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-02-27 02:54:44,461 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45281 2024-02-27 02:54:44,462 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40779 2024-02-27 02:54:44,464 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-02-27 02:54:44,464 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-02-27 02:54:44,467 INFO [RS:0;jenkins-hbase4:40779] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-02-27 02:54:44,467 INFO [RS:1;jenkins-hbase4:45281] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-02-27 02:54:44,468 INFO [RS:0;jenkins-hbase4:40779] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-02-27 02:54:44,468 INFO [RS:1;jenkins-hbase4:45281] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-02-27 02:54:44,468 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1025): About to register with Master. 2024-02-27 02:54:44,468 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1025): About to register with Master. 2024-02-27 02:54:44,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-02-27 02:54:44,470 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-02-27 02:54:44,471 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,42961,1709002482057 with isa=jenkins-hbase4.apache.org/172.31.14.131:40779, startcode=1709002483314 2024-02-27 02:54:44,471 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,42961,1709002482057 with isa=jenkins-hbase4.apache.org/172.31.14.131:45281, startcode=1709002483366 2024-02-27 02:54:44,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-02-27 02:54:44,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-02-27 02:54:44,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-02-27 02:54:44,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-02-27 02:54:44,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-02-27 02:54:44,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-02-27 02:54:44,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-02-27 02:54:44,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-02-27 02:54:44,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-02-27 02:54:44,492 DEBUG [RS:1;jenkins-hbase4:45281] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-02-27 02:54:44,492 DEBUG [RS:0;jenkins-hbase4:40779] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-02-27 02:54:44,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709002484490,5,FailOnTimeoutGroup] 2024-02-27 02:54:44,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709002484494,5,FailOnTimeoutGroup] 2024-02-27 02:54:44,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-02-27 02:54:44,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,525 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-02-27 02:54:44,527 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-02-27 02:54:44,528 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb 2024-02-27 02:54:44,556 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:44,560 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-02-27 02:54:44,563 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/info 2024-02-27 02:54:44,564 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-02-27 02:54:44,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:44,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-02-27 02:54:44,568 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53911, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-02-27 02:54:44,568 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45403, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-02-27 02:54:44,570 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/rep_barrier 2024-02-27 02:54:44,571 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-02-27 02:54:44,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:44,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-02-27 02:54:44,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/table 2024-02-27 02:54:44,576 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-02-27 02:54:44,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:44,578 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740 2024-02-27 02:54:44,579 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740 2024-02-27 02:54:44,580 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42961] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:44,583 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-02-27 02:54:44,585 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-02-27 02:54:44,589 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:44,591 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66172087, jitterRate=-0.013959065079689026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-02-27 02:54:44,591 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-02-27 02:54:44,591 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-02-27 02:54:44,591 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-02-27 02:54:44,591 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-02-27 02:54:44,591 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-02-27 02:54:44,591 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-02-27 02:54:44,592 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42961] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:44,593 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-02-27 02:54:44,593 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-02-27 02:54:44,599 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb 2024-02-27 02:54:44,599 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb 2024-02-27 02:54:44,599 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:35999 2024-02-27 02:54:44,600 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:35999 2024-02-27 02:54:44,600 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-02-27 02:54:44,600 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-02-27 02:54:44,600 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-02-27 02:54:44,600 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-02-27 02:54:44,607 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 02:54:44,608 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ZKUtil(163): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:44,608 DEBUG [RS:0;jenkins-hbase4:40779] zookeeper.ZKUtil(163): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:44,608 WARN [RS:1;jenkins-hbase4:45281] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-27 02:54:44,608 WARN [RS:0;jenkins-hbase4:40779] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-27 02:54:44,609 INFO [RS:1;jenkins-hbase4:45281] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-27 02:54:44,609 INFO [RS:0;jenkins-hbase4:40779] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-27 02:54:44,609 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1950): logDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/WALs/jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:44,609 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1950): logDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/WALs/jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:44,610 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40779,1709002483314] 2024-02-27 02:54:44,610 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45281,1709002483366] 2024-02-27 02:54:44,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-02-27 02:54:44,621 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ZKUtil(163): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:44,621 DEBUG [RS:0;jenkins-hbase4:40779] zookeeper.ZKUtil(163): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:44,622 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ZKUtil(163): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:44,622 DEBUG [RS:0;jenkins-hbase4:40779] zookeeper.ZKUtil(163): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:44,626 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-02-27 02:54:44,628 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-02-27 02:54:44,635 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-02-27 02:54:44,635 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-02-27 02:54:44,644 INFO [RS:0;jenkins-hbase4:40779] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-02-27 02:54:44,644 INFO [RS:1;jenkins-hbase4:45281] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-02-27 02:54:44,665 INFO [RS:0;jenkins-hbase4:40779] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-02-27 02:54:44,665 INFO [RS:1;jenkins-hbase4:45281] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-02-27 02:54:44,669 INFO [RS:0;jenkins-hbase4:40779] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-02-27 02:54:44,669 INFO [RS:1;jenkins-hbase4:45281] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-02-27 02:54:44,670 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,670 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,670 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-02-27 02:54:44,671 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-02-27 02:54:44,679 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,679 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,679 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,679 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-27 02:54:44,680 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-27 02:54:44,680 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,680 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,681 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,681 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,681 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,681 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,681 DEBUG [RS:0;jenkins-hbase4:40779] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,681 DEBUG [RS:1;jenkins-hbase4:45281] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 02:54:44,684 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,684 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,684 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,684 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,684 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,684 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,684 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,685 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,708 INFO [RS:0;jenkins-hbase4:40779] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-02-27 02:54:44,708 INFO [RS:1;jenkins-hbase4:45281] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-02-27 02:54:44,711 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40779,1709002483314-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,711 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45281,1709002483366-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,736 INFO [RS:1;jenkins-hbase4:45281] regionserver.Replication(203): jenkins-hbase4.apache.org,45281,1709002483366 started 2024-02-27 02:54:44,736 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,45281,1709002483366, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45281, sessionid=0x1000ddd257b0002 2024-02-27 02:54:44,737 INFO [RS:0;jenkins-hbase4:40779] regionserver.Replication(203): jenkins-hbase4.apache.org,40779,1709002483314 started 2024-02-27 02:54:44,737 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-02-27 02:54:44,737 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,40779,1709002483314, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40779, sessionid=0x1000ddd257b0001 2024-02-27 02:54:44,737 DEBUG [RS:1;jenkins-hbase4:45281] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:44,737 DEBUG [RS:0;jenkins-hbase4:40779] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-02-27 02:54:44,737 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45281,1709002483366' 2024-02-27 02:54:44,737 DEBUG [RS:0;jenkins-hbase4:40779] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:44,738 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-02-27 02:54:44,738 DEBUG [RS:0;jenkins-hbase4:40779] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40779,1709002483314' 2024-02-27 02:54:44,738 DEBUG [RS:0;jenkins-hbase4:40779] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-02-27 02:54:44,739 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-02-27 02:54:44,739 DEBUG [RS:0;jenkins-hbase4:40779] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-02-27 02:54:44,740 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-02-27 02:54:44,740 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-02-27 02:54:44,740 DEBUG [RS:0;jenkins-hbase4:40779] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-02-27 02:54:44,740 DEBUG [RS:0;jenkins-hbase4:40779] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-02-27 02:54:44,740 DEBUG [RS:1;jenkins-hbase4:45281] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:44,740 DEBUG [RS:0;jenkins-hbase4:40779] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:44,741 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45281,1709002483366' 2024-02-27 02:54:44,741 DEBUG [RS:0;jenkins-hbase4:40779] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40779,1709002483314' 2024-02-27 02:54:44,741 DEBUG [RS:0;jenkins-hbase4:40779] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-02-27 02:54:44,741 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-02-27 02:54:44,742 DEBUG [RS:0;jenkins-hbase4:40779] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-02-27 02:54:44,742 DEBUG [RS:1;jenkins-hbase4:45281] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-02-27 02:54:44,742 DEBUG [RS:0;jenkins-hbase4:40779] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-02-27 02:54:44,742 DEBUG [RS:1;jenkins-hbase4:45281] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-02-27 02:54:44,742 INFO [RS:0;jenkins-hbase4:40779] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-02-27 02:54:44,742 INFO [RS:1;jenkins-hbase4:45281] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-02-27 02:54:44,745 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,745 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,745 DEBUG [RS:0;jenkins-hbase4:40779] zookeeper.ZKUtil(399): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-02-27 02:54:44,745 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ZKUtil(399): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-02-27 02:54:44,745 INFO [RS:0;jenkins-hbase4:40779] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-02-27 02:54:44,746 INFO [RS:1;jenkins-hbase4:45281] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-02-27 02:54:44,746 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,746 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,746 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,746 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:44,780 DEBUG [jenkins-hbase4:42961] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-02-27 02:54:44,784 DEBUG [jenkins-hbase4:42961] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 02:54:44,790 DEBUG [jenkins-hbase4:42961] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 02:54:44,790 DEBUG [jenkins-hbase4:42961] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 02:54:44,790 DEBUG [jenkins-hbase4:42961] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 02:54:44,793 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40779,1709002483314, state=OPENING 2024-02-27 02:54:44,800 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-02-27 02:54:44,802 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:54:44,803 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-02-27 02:54:44,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40779,1709002483314}] 2024-02-27 02:54:44,859 INFO [RS:0;jenkins-hbase4:40779] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40779%2C1709002483314, suffix=, logDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/WALs/jenkins-hbase4.apache.org,40779,1709002483314, archiveDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/oldWALs, maxLogs=32 2024-02-27 02:54:44,859 INFO [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45281%2C1709002483366, suffix=, logDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/WALs/jenkins-hbase4.apache.org,45281,1709002483366, archiveDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/oldWALs, maxLogs=32 2024-02-27 02:54:44,882 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36911,DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1,DISK] 2024-02-27 02:54:44,883 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46829,DS-6e5333b8-4087-4d2f-b759-77f4ef659dae,DISK] 2024-02-27 02:54:44,891 INFO [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/WALs/jenkins-hbase4.apache.org,45281,1709002483366/jenkins-hbase4.apache.org%2C45281%2C1709002483366.1709002484864 2024-02-27 02:54:44,891 DEBUG [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36911,DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1,DISK], DatanodeInfoWithStorage[127.0.0.1:46829,DS-6e5333b8-4087-4d2f-b759-77f4ef659dae,DISK]] 2024-02-27 02:54:44,895 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46829,DS-6e5333b8-4087-4d2f-b759-77f4ef659dae,DISK] 2024-02-27 02:54:44,895 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36911,DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1,DISK] 2024-02-27 02:54:44,922 INFO [RS:0;jenkins-hbase4:40779] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/WALs/jenkins-hbase4.apache.org,40779,1709002483314/jenkins-hbase4.apache.org%2C40779%2C1709002483314.1709002484864 2024-02-27 02:54:44,922 DEBUG [RS:0;jenkins-hbase4:40779] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46829,DS-6e5333b8-4087-4d2f-b759-77f4ef659dae,DISK], DatanodeInfoWithStorage[127.0.0.1:36911,DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1,DISK]] 2024-02-27 02:54:44,991 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:44,994 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-02-27 02:54:45,000 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-02-27 02:54:45,013 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-02-27 02:54:45,014 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-27 02:54:45,018 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40779%2C1709002483314.meta, suffix=.meta, logDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/WALs/jenkins-hbase4.apache.org,40779,1709002483314, archiveDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/oldWALs, maxLogs=32 2024-02-27 02:54:45,037 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46829,DS-6e5333b8-4087-4d2f-b759-77f4ef659dae,DISK] 2024-02-27 02:54:45,038 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36911,DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1,DISK] 2024-02-27 02:54:45,046 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/WALs/jenkins-hbase4.apache.org,40779,1709002483314/jenkins-hbase4.apache.org%2C40779%2C1709002483314.meta.1709002485019.meta 2024-02-27 02:54:45,046 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46829,DS-6e5333b8-4087-4d2f-b759-77f4ef659dae,DISK], DatanodeInfoWithStorage[127.0.0.1:36911,DS-50fe6f23-4558-4c9f-aa11-6dffc30b90d1,DISK]] 2024-02-27 02:54:45,046 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-02-27 02:54:45,049 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-02-27 02:54:45,069 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-02-27 02:54:45,074 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-02-27 02:54:45,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-02-27 02:54:45,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:45,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-02-27 02:54:45,079 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-02-27 02:54:45,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-02-27 02:54:45,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/info 2024-02-27 02:54:45,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/info 2024-02-27 02:54:45,087 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-02-27 02:54:45,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:45,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-02-27 02:54:45,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/rep_barrier 2024-02-27 02:54:45,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/rep_barrier 2024-02-27 02:54:45,090 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-02-27 02:54:45,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:45,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-02-27 02:54:45,094 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/table 2024-02-27 02:54:45,094 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/table 2024-02-27 02:54:45,094 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-02-27 02:54:45,095 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:45,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740 2024-02-27 02:54:45,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740 2024-02-27 02:54:45,104 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-02-27 02:54:45,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-02-27 02:54:45,108 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71289670, jitterRate=0.062298864126205444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-02-27 02:54:45,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-02-27 02:54:45,122 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1709002484983 2024-02-27 02:54:45,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-02-27 02:54:45,147 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-02-27 02:54:45,148 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40779,1709002483314, state=OPEN 2024-02-27 02:54:45,151 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-02-27 02:54:45,151 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-02-27 02:54:45,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-02-27 02:54:45,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40779,1709002483314 in 346 msec 2024-02-27 02:54:45,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-02-27 02:54:45,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 547 msec 2024-02-27 02:54:45,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 802 msec 2024-02-27 02:54:45,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1709002485167, completionTime=-1 2024-02-27 02:54:45,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-02-27 02:54:45,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-02-27 02:54:45,237 DEBUG [hconnection-0x684de3-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 02:54:45,240 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-27 02:54:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-02-27 02:54:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1709002545263 2024-02-27 02:54:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1709002605263 2024-02-27 02:54:45,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 95 msec 2024-02-27 02:54:45,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42961,1709002482057-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:45,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42961,1709002482057-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:45,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42961,1709002482057-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:45,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42961, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:45,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:45,297 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-02-27 02:54:45,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-02-27 02:54:45,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-02-27 02:54:45,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-02-27 02:54:45,320 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 02:54:45,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 02:54:45,345 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/hbase/namespace/d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,347 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/hbase/namespace/d26724700b807a345a15af1d04fb898e empty. 2024-02-27 02:54:45,348 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/hbase/namespace/d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,348 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-02-27 02:54:45,377 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-02-27 02:54:45,379 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d26724700b807a345a15af1d04fb898e, NAME => 'hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp 2024-02-27 02:54:45,398 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:45,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d26724700b807a345a15af1d04fb898e, disabling compactions & flushes 2024-02-27 02:54:45,399 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:54:45,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:54:45,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. after waiting 0 ms 2024-02-27 02:54:45,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:54:45,399 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:54:45,399 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d26724700b807a345a15af1d04fb898e: 2024-02-27 02:54:45,404 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 02:54:45,419 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709002485407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002485407"}]},"ts":"1709002485407"} 2024-02-27 02:54:45,450 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 02:54:45,452 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 02:54:45,458 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002485453"}]},"ts":"1709002485453"} 2024-02-27 02:54:45,462 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-02-27 02:54:45,467 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 02:54:45,469 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 02:54:45,469 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 02:54:45,469 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 02:54:45,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d26724700b807a345a15af1d04fb898e, ASSIGN}] 2024-02-27 02:54:45,474 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d26724700b807a345a15af1d04fb898e, ASSIGN 2024-02-27 02:54:45,477 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d26724700b807a345a15af1d04fb898e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45281,1709002483366; forceNewPlan=false, retain=false 2024-02-27 02:54:45,630 INFO [jenkins-hbase4:42961] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 02:54:45,631 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d26724700b807a345a15af1d04fb898e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:45,631 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709002485631"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002485631"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002485631"}]},"ts":"1709002485631"} 2024-02-27 02:54:45,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d26724700b807a345a15af1d04fb898e, server=jenkins-hbase4.apache.org,45281,1709002483366}] 2024-02-27 02:54:45,793 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:45,793 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-02-27 02:54:45,796 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-02-27 02:54:45,802 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:54:45,803 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d26724700b807a345a15af1d04fb898e, NAME => 'hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e.', STARTKEY => '', ENDKEY => ''} 2024-02-27 02:54:45,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:45,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,807 INFO [StoreOpener-d26724700b807a345a15af1d04fb898e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,809 DEBUG [StoreOpener-d26724700b807a345a15af1d04fb898e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e/info 2024-02-27 02:54:45,809 DEBUG [StoreOpener-d26724700b807a345a15af1d04fb898e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e/info 2024-02-27 02:54:45,810 INFO [StoreOpener-d26724700b807a345a15af1d04fb898e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d26724700b807a345a15af1d04fb898e columnFamilyName info 2024-02-27 02:54:45,811 INFO [StoreOpener-d26724700b807a345a15af1d04fb898e-1] regionserver.HStore(310): Store=d26724700b807a345a15af1d04fb898e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:45,812 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,813 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,818 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d26724700b807a345a15af1d04fb898e 2024-02-27 02:54:45,821 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:45,822 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d26724700b807a345a15af1d04fb898e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64727013, jitterRate=-0.035492345690727234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 02:54:45,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d26724700b807a345a15af1d04fb898e: 2024-02-27 02:54:45,824 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e., pid=6, masterSystemTime=1709002485792 2024-02-27 02:54:45,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:54:45,830 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:54:45,831 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d26724700b807a345a15af1d04fb898e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:45,831 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709002485830"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709002485830"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709002485830"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709002485830"}]},"ts":"1709002485830"} 2024-02-27 02:54:45,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-02-27 02:54:45,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d26724700b807a345a15af1d04fb898e, server=jenkins-hbase4.apache.org,45281,1709002483366 in 197 msec 2024-02-27 02:54:45,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-02-27 02:54:45,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d26724700b807a345a15af1d04fb898e, ASSIGN in 368 msec 2024-02-27 02:54:45,845 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 02:54:45,845 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002485845"}]},"ts":"1709002485845"} 2024-02-27 02:54:45,849 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-02-27 02:54:45,852 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 02:54:45,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 545 msec 2024-02-27 02:54:45,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-02-27 02:54:45,922 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-02-27 02:54:45,922 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:54:45,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 02:54:45,946 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-27 02:54:45,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-02-27 02:54:45,981 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-27 02:54:45,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2024-02-27 02:54:45,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-02-27 02:54:46,006 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-27 02:54:46,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2024-02-27 02:54:46,020 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-02-27 02:54:46,023 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-02-27 02:54:46,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.590sec 2024-02-27 02:54:46,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-02-27 02:54:46,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 02:54:46,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-02-27 02:54:46,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-02-27 02:54:46,030 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 02:54:46,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-02-27 02:54:46,033 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 02:54:46,035 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,036 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a empty. 2024-02-27 02:54:46,038 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,038 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-02-27 02:54:46,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-02-27 02:54:46,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-02-27 02:54:46,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:46,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:46,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-02-27 02:54:46,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-02-27 02:54:46,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42961,1709002482057-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-02-27 02:54:46,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42961,1709002482057-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-02-27 02:54:46,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-02-27 02:54:46,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42961,1709002482057-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 02:54:46,064 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-02-27 02:54:46,065 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7c657e623e20e030ae9ece5671d02a4a, NAME => 'hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp 2024-02-27 02:54:46,094 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:46,094 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 7c657e623e20e030ae9ece5671d02a4a, disabling compactions & flushes 2024-02-27 02:54:46,094 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:54:46,094 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:54:46,094 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. after waiting 0 ms 2024-02-27 02:54:46,094 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:54:46,094 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:54:46,094 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 7c657e623e20e030ae9ece5671d02a4a: 2024-02-27 02:54:46,099 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 02:54:46,101 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709002486101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002486101"}]},"ts":"1709002486101"} 2024-02-27 02:54:46,102 DEBUG [Listener at localhost/35297] zookeeper.ReadOnlyZKClient(139): Connect 0x141fbce7 to 127.0.0.1:63173 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-27 02:54:46,105 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 02:54:46,107 DEBUG [Listener at localhost/35297] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dac8c69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-27 02:54:46,107 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 02:54:46,107 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002486107"}]},"ts":"1709002486107"} 2024-02-27 02:54:46,110 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-02-27 02:54:46,116 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 02:54:46,118 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 02:54:46,118 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 02:54:46,118 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 02:54:46,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=7c657e623e20e030ae9ece5671d02a4a, ASSIGN}] 2024-02-27 02:54:46,121 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=7c657e623e20e030ae9ece5671d02a4a, ASSIGN 2024-02-27 02:54:46,123 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=7c657e623e20e030ae9ece5671d02a4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40779,1709002483314; forceNewPlan=false, retain=false 2024-02-27 02:54:46,125 DEBUG [hconnection-0x7a3aeb30-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 02:54:46,138 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-27 02:54:46,149 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:54:46,150 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:46,153 DEBUG [Listener at localhost/35297] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-27 02:54:46,256 DEBUG [Listener at localhost/35297] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-27 02:54:46,273 INFO [jenkins-hbase4:42961] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 02:54:46,274 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7c657e623e20e030ae9ece5671d02a4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:46,275 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709002486274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002486274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002486274"}]},"ts":"1709002486274"} 2024-02-27 02:54:46,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7c657e623e20e030ae9ece5671d02a4a, server=jenkins-hbase4.apache.org,40779,1709002483314}] 2024-02-27 02:54:46,359 DEBUG [Listener at localhost/35297] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-27 02:54:46,432 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:46,440 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:54:46,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c657e623e20e030ae9ece5671d02a4a, NAME => 'hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a.', STARTKEY => '', ENDKEY => ''} 2024-02-27 02:54:46,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:46,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,441 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,443 INFO [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,446 DEBUG [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/q 2024-02-27 02:54:46,446 DEBUG [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/q 2024-02-27 02:54:46,446 INFO [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c657e623e20e030ae9ece5671d02a4a columnFamilyName q 2024-02-27 02:54:46,447 INFO [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] regionserver.HStore(310): Store=7c657e623e20e030ae9ece5671d02a4a/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:46,447 INFO [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,450 DEBUG [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/u 2024-02-27 02:54:46,450 DEBUG [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/u 2024-02-27 02:54:46,450 INFO [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c657e623e20e030ae9ece5671d02a4a columnFamilyName u 2024-02-27 02:54:46,451 INFO [StoreOpener-7c657e623e20e030ae9ece5671d02a4a-1] regionserver.HStore(310): Store=7c657e623e20e030ae9ece5671d02a4a/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:46,453 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,454 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-02-27 02:54:46,460 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:54:46,461 DEBUG [Listener at localhost/35297] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-27 02:54:46,463 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:46,464 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c657e623e20e030ae9ece5671d02a4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62259393, jitterRate=-0.07226274907588959}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-02-27 02:54:46,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c657e623e20e030ae9ece5671d02a4a: 2024-02-27 02:54:46,465 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a., pid=11, masterSystemTime=1709002486432 2024-02-27 02:54:46,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:54:46,468 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:54:46,469 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7c657e623e20e030ae9ece5671d02a4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:46,470 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709002486469"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709002486469"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709002486469"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709002486469"}]},"ts":"1709002486469"} 2024-02-27 02:54:46,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-02-27 02:54:46,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7c657e623e20e030ae9ece5671d02a4a, server=jenkins-hbase4.apache.org,40779,1709002483314 in 195 msec 2024-02-27 02:54:46,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-02-27 02:54:46,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=7c657e623e20e030ae9ece5671d02a4a, ASSIGN in 358 msec 2024-02-27 02:54:46,481 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 02:54:46,481 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002486481"}]},"ts":"1709002486481"} 2024-02-27 02:54:46,483 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-02-27 02:54:46,487 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 02:54:46,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 461 msec 2024-02-27 02:54:46,576 DEBUG [Listener at localhost/35297] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-27 02:54:46,579 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-02-27 02:54:46,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 02:54:46,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-02-27 02:54:46,612 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 02:54:46,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 02:54:46,617 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:46,618 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda empty. 2024-02-27 02:54:46,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-02-27 02:54:46,619 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:46,619 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-02-27 02:54:46,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-27 02:54:46,639 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-02-27 02:54:46,640 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => cbdc153023ab614cfd623baf4d038bda, NAME => 'TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp 2024-02-27 02:54:46,656 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:46,656 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing cbdc153023ab614cfd623baf4d038bda, disabling compactions & flushes 2024-02-27 02:54:46,656 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:54:46,656 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:54:46,656 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. after waiting 0 ms 2024-02-27 02:54:46,656 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:54:46,656 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:54:46,656 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for cbdc153023ab614cfd623baf4d038bda: 2024-02-27 02:54:46,661 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 02:54:46,663 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002486663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002486663"}]},"ts":"1709002486663"} 2024-02-27 02:54:46,666 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 02:54:46,668 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 02:54:46,668 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002486668"}]},"ts":"1709002486668"} 2024-02-27 02:54:46,670 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-02-27 02:54:46,675 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 02:54:46,676 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 02:54:46,676 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 02:54:46,676 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 02:54:46,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cbdc153023ab614cfd623baf4d038bda, ASSIGN}] 2024-02-27 02:54:46,678 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cbdc153023ab614cfd623baf4d038bda, ASSIGN 2024-02-27 02:54:46,679 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cbdc153023ab614cfd623baf4d038bda, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45281,1709002483366; forceNewPlan=false, retain=false 2024-02-27 02:54:46,830 INFO [jenkins-hbase4:42961] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 02:54:46,831 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cbdc153023ab614cfd623baf4d038bda, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:46,831 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002486831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002486831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002486831"}]},"ts":"1709002486831"} 2024-02-27 02:54:46,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure cbdc153023ab614cfd623baf4d038bda, server=jenkins-hbase4.apache.org,45281,1709002483366}] 2024-02-27 02:54:46,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-27 02:54:46,988 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:46,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:54:46,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cbdc153023ab614cfd623baf4d038bda, NAME => 'TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.', STARTKEY => '', ENDKEY => ''} 2024-02-27 02:54:46,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:46,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:46,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:46,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:46,998 INFO [StoreOpener-cbdc153023ab614cfd623baf4d038bda-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:47,001 DEBUG [StoreOpener-cbdc153023ab614cfd623baf4d038bda-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/cf 2024-02-27 02:54:47,001 DEBUG [StoreOpener-cbdc153023ab614cfd623baf4d038bda-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/cf 2024-02-27 02:54:47,001 INFO [StoreOpener-cbdc153023ab614cfd623baf4d038bda-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cbdc153023ab614cfd623baf4d038bda columnFamilyName cf 2024-02-27 02:54:47,002 INFO [StoreOpener-cbdc153023ab614cfd623baf4d038bda-1] regionserver.HStore(310): Store=cbdc153023ab614cfd623baf4d038bda/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:47,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:47,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:47,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:54:47,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:47,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cbdc153023ab614cfd623baf4d038bda; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71203938, jitterRate=0.0610213577747345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 02:54:47,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cbdc153023ab614cfd623baf4d038bda: 2024-02-27 02:54:47,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda., pid=14, masterSystemTime=1709002486988 2024-02-27 02:54:47,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:54:47,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:54:47,020 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cbdc153023ab614cfd623baf4d038bda, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:47,020 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002487020"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709002487020"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709002487020"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709002487020"}]},"ts":"1709002487020"} 2024-02-27 02:54:47,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-02-27 02:54:47,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure cbdc153023ab614cfd623baf4d038bda, server=jenkins-hbase4.apache.org,45281,1709002483366 in 189 msec 2024-02-27 02:54:47,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-02-27 02:54:47,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cbdc153023ab614cfd623baf4d038bda, ASSIGN in 350 msec 2024-02-27 02:54:47,031 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 02:54:47,031 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002487031"}]},"ts":"1709002487031"} 2024-02-27 02:54:47,033 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-02-27 02:54:47,036 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 02:54:47,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 429 msec 2024-02-27 02:54:47,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-27 02:54:47,389 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-02-27 02:54:47,389 DEBUG [Listener at localhost/35297] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-02-27 02:54:47,390 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:47,395 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-02-27 02:54:47,395 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:47,396 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-02-27 02:54:47,396 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:47,405 DEBUG [hconnection-0x7a3aeb30-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 02:54:47,408 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-27 02:54:47,413 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-27 02:54:47,415 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-02-27 02:54:47,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 02:54:47,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-02-27 02:54:47,421 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 02:54:47,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-02-27 02:54:47,426 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 02:54:47,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-27 02:54:47,428 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,429 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2 empty. 2024-02-27 02:54:47,430 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,430 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-02-27 02:54:47,457 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-02-27 02:54:47,459 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 71407bcf9331ea959ba1c3d5a2fa2be2, NAME => 'TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp 2024-02-27 02:54:47,466 DEBUG [hconnection-0x699e80c5-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 02:54:47,469 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-02-27 02:54:47,485 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:47,485 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 71407bcf9331ea959ba1c3d5a2fa2be2, disabling compactions & flushes 2024-02-27 02:54:47,485 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:54:47,485 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:54:47,485 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. after waiting 0 ms 2024-02-27 02:54:47,485 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:54:47,485 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:54:47,485 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 71407bcf9331ea959ba1c3d5a2fa2be2: 2024-02-27 02:54:47,489 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 02:54:47,491 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002487490"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002487490"}]},"ts":"1709002487490"} 2024-02-27 02:54:47,493 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 02:54:47,494 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 02:54:47,494 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002487494"}]},"ts":"1709002487494"} 2024-02-27 02:54:47,496 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-02-27 02:54:47,500 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 02:54:47,501 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 02:54:47,501 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 02:54:47,501 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 02:54:47,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=71407bcf9331ea959ba1c3d5a2fa2be2, ASSIGN}] 2024-02-27 02:54:47,503 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=71407bcf9331ea959ba1c3d5a2fa2be2, ASSIGN 2024-02-27 02:54:47,504 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=71407bcf9331ea959ba1c3d5a2fa2be2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40779,1709002483314; forceNewPlan=false, retain=false 2024-02-27 02:54:47,654 INFO [jenkins-hbase4:42961] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 02:54:47,656 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=71407bcf9331ea959ba1c3d5a2fa2be2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:47,656 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002487655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002487655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002487655"}]},"ts":"1709002487655"} 2024-02-27 02:54:47,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 71407bcf9331ea959ba1c3d5a2fa2be2, server=jenkins-hbase4.apache.org,40779,1709002483314}] 2024-02-27 02:54:47,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-27 02:54:47,812 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:47,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:54:47,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71407bcf9331ea959ba1c3d5a2fa2be2, NAME => 'TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.', STARTKEY => '', ENDKEY => ''} 2024-02-27 02:54:47,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:47,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,820 INFO [StoreOpener-71407bcf9331ea959ba1c3d5a2fa2be2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,822 DEBUG [StoreOpener-71407bcf9331ea959ba1c3d5a2fa2be2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2/cf 2024-02-27 02:54:47,822 DEBUG [StoreOpener-71407bcf9331ea959ba1c3d5a2fa2be2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2/cf 2024-02-27 02:54:47,823 INFO [StoreOpener-71407bcf9331ea959ba1c3d5a2fa2be2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71407bcf9331ea959ba1c3d5a2fa2be2 columnFamilyName cf 2024-02-27 02:54:47,823 INFO [StoreOpener-71407bcf9331ea959ba1c3d5a2fa2be2-1] regionserver.HStore(310): Store=71407bcf9331ea959ba1c3d5a2fa2be2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:47,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:54:47,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:47,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 71407bcf9331ea959ba1c3d5a2fa2be2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74735707, jitterRate=0.11364881694316864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 02:54:47,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 71407bcf9331ea959ba1c3d5a2fa2be2: 2024-02-27 02:54:47,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2., pid=17, masterSystemTime=1709002487812 2024-02-27 02:54:47,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:54:47,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:54:47,843 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=71407bcf9331ea959ba1c3d5a2fa2be2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:47,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002487843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709002487843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709002487843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709002487843"}]},"ts":"1709002487843"} 2024-02-27 02:54:47,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-02-27 02:54:47,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 71407bcf9331ea959ba1c3d5a2fa2be2, server=jenkins-hbase4.apache.org,40779,1709002483314 in 187 msec 2024-02-27 02:54:47,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-02-27 02:54:47,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=71407bcf9331ea959ba1c3d5a2fa2be2, ASSIGN in 347 msec 2024-02-27 02:54:47,853 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 02:54:47,854 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002487853"}]},"ts":"1709002487853"} 2024-02-27 02:54:47,855 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-02-27 02:54:47,859 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 02:54:47,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 443 msec 2024-02-27 02:54:48,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-27 02:54:48,181 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-02-27 02:54:48,181 DEBUG [Listener at localhost/35297] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-02-27 02:54:48,181 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:48,185 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-02-27 02:54:48,185 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:48,185 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-02-27 02:54:48,185 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:48,196 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-27 02:54:48,200 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-02-27 02:54:48,201 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 02:54:48,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-02-27 02:54:48,206 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 02:54:48,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-02-27 02:54:48,207 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 02:54:48,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-27 02:54:48,210 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,211 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d empty. 2024-02-27 02:54:48,212 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,212 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-02-27 02:54:48,233 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-02-27 02:54:48,235 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => b3942222c94335d2a72a8bd8e3f0328d, NAME => 'TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp 2024-02-27 02:54:48,248 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:48,249 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing b3942222c94335d2a72a8bd8e3f0328d, disabling compactions & flushes 2024-02-27 02:54:48,249 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:54:48,249 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:54:48,249 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. after waiting 0 ms 2024-02-27 02:54:48,249 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:54:48,249 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:54:48,249 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for b3942222c94335d2a72a8bd8e3f0328d: 2024-02-27 02:54:48,253 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 02:54:48,255 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002488255"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002488255"}]},"ts":"1709002488255"} 2024-02-27 02:54:48,257 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 02:54:48,258 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 02:54:48,259 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002488259"}]},"ts":"1709002488259"} 2024-02-27 02:54:48,261 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-02-27 02:54:48,267 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 02:54:48,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 02:54:48,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 02:54:48,268 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 02:54:48,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b3942222c94335d2a72a8bd8e3f0328d, ASSIGN}] 2024-02-27 02:54:48,269 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b3942222c94335d2a72a8bd8e3f0328d, ASSIGN 2024-02-27 02:54:48,271 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b3942222c94335d2a72a8bd8e3f0328d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40779,1709002483314; forceNewPlan=false, retain=false 2024-02-27 02:54:48,421 INFO [jenkins-hbase4:42961] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 02:54:48,422 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b3942222c94335d2a72a8bd8e3f0328d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:48,422 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002488422"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002488422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002488422"}]},"ts":"1709002488422"} 2024-02-27 02:54:48,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure b3942222c94335d2a72a8bd8e3f0328d, server=jenkins-hbase4.apache.org,40779,1709002483314}] 2024-02-27 02:54:48,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-27 02:54:48,578 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:48,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:54:48,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b3942222c94335d2a72a8bd8e3f0328d, NAME => 'TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.', STARTKEY => '', ENDKEY => ''} 2024-02-27 02:54:48,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:48,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,587 INFO [StoreOpener-b3942222c94335d2a72a8bd8e3f0328d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,589 DEBUG [StoreOpener-b3942222c94335d2a72a8bd8e3f0328d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d/cf 2024-02-27 02:54:48,589 DEBUG [StoreOpener-b3942222c94335d2a72a8bd8e3f0328d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d/cf 2024-02-27 02:54:48,590 INFO [StoreOpener-b3942222c94335d2a72a8bd8e3f0328d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3942222c94335d2a72a8bd8e3f0328d columnFamilyName cf 2024-02-27 02:54:48,591 INFO [StoreOpener-b3942222c94335d2a72a8bd8e3f0328d-1] regionserver.HStore(310): Store=b3942222c94335d2a72a8bd8e3f0328d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:48,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:54:48,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:48,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b3942222c94335d2a72a8bd8e3f0328d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63774225, jitterRate=-0.049689993262290955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 02:54:48,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b3942222c94335d2a72a8bd8e3f0328d: 2024-02-27 02:54:48,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d., pid=20, masterSystemTime=1709002488578 2024-02-27 02:54:48,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:54:48,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:54:48,608 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b3942222c94335d2a72a8bd8e3f0328d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:48,608 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002488608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709002488608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709002488608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709002488608"}]},"ts":"1709002488608"} 2024-02-27 02:54:48,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-02-27 02:54:48,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure b3942222c94335d2a72a8bd8e3f0328d, server=jenkins-hbase4.apache.org,40779,1709002483314 in 185 msec 2024-02-27 02:54:48,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-02-27 02:54:48,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b3942222c94335d2a72a8bd8e3f0328d, ASSIGN in 345 msec 2024-02-27 02:54:48,618 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 02:54:48,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002488618"}]},"ts":"1709002488618"} 2024-02-27 02:54:48,620 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-02-27 02:54:48,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 02:54:48,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 422 msec 2024-02-27 02:54:48,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-27 02:54:48,963 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-02-27 02:54:48,963 DEBUG [Listener at localhost/35297] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-02-27 02:54:48,963 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:48,967 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-02-27 02:54:48,967 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:48,967 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-02-27 02:54:48,967 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:48,982 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-02-27 02:54:48,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-02-27 02:54:48,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-02-27 02:54:48,998 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-27 02:54:49,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 19 msec 2024-02-27 02:54:49,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-02-27 02:54:49,246 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 02:54:49,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-02-27 02:54:49,249 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 02:54:49,250 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-02-27 02:54:49,251 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 02:54:49,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-27 02:54:49,254 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,254 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,255 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212 empty. 2024-02-27 02:54:49,255 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c empty. 2024-02-27 02:54:49,256 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,256 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,256 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-02-27 02:54:49,275 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-02-27 02:54:49,277 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => c6c2a4b32c87492f2776e5464c461212, NAME => 'TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp 2024-02-27 02:54:49,277 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 48bef6aadbd622f536b9e765beca811c, NAME => 'TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp 2024-02-27 02:54:49,302 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:49,302 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 48bef6aadbd622f536b9e765beca811c, disabling compactions & flushes 2024-02-27 02:54:49,302 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:54:49,303 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:54:49,303 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. after waiting 0 ms 2024-02-27 02:54:49,303 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:54:49,303 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:54:49,303 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 48bef6aadbd622f536b9e765beca811c: 2024-02-27 02:54:49,305 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:49,306 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing c6c2a4b32c87492f2776e5464c461212, disabling compactions & flushes 2024-02-27 02:54:49,306 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:54:49,306 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:54:49,306 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. after waiting 0 ms 2024-02-27 02:54:49,306 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:54:49,306 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:54:49,306 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for c6c2a4b32c87492f2776e5464c461212: 2024-02-27 02:54:49,310 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 02:54:49,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002489312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002489312"}]},"ts":"1709002489312"} 2024-02-27 02:54:49,312 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002489312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002489312"}]},"ts":"1709002489312"} 2024-02-27 02:54:49,319 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-02-27 02:54:49,321 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 02:54:49,321 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002489321"}]},"ts":"1709002489321"} 2024-02-27 02:54:49,323 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-02-27 02:54:49,328 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 02:54:49,331 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 02:54:49,331 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 02:54:49,331 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 02:54:49,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=c6c2a4b32c87492f2776e5464c461212, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=48bef6aadbd622f536b9e765beca811c, ASSIGN}] 2024-02-27 02:54:49,333 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=48bef6aadbd622f536b9e765beca811c, ASSIGN 2024-02-27 02:54:49,334 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=c6c2a4b32c87492f2776e5464c461212, ASSIGN 2024-02-27 02:54:49,335 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=48bef6aadbd622f536b9e765beca811c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40779,1709002483314; forceNewPlan=false, retain=false 2024-02-27 02:54:49,335 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=c6c2a4b32c87492f2776e5464c461212, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45281,1709002483366; forceNewPlan=false, retain=false 2024-02-27 02:54:49,486 INFO [jenkins-hbase4:42961] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-02-27 02:54:49,487 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=48bef6aadbd622f536b9e765beca811c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:49,487 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c6c2a4b32c87492f2776e5464c461212, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:49,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002489487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002489487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002489487"}]},"ts":"1709002489487"} 2024-02-27 02:54:49,488 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002489487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002489487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002489487"}]},"ts":"1709002489487"} 2024-02-27 02:54:49,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 48bef6aadbd622f536b9e765beca811c, server=jenkins-hbase4.apache.org,40779,1709002483314}] 2024-02-27 02:54:49,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure c6c2a4b32c87492f2776e5464c461212, server=jenkins-hbase4.apache.org,45281,1709002483366}] 2024-02-27 02:54:49,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-27 02:54:49,643 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:49,645 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:49,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:54:49,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 48bef6aadbd622f536b9e765beca811c, NAME => 'TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.', STARTKEY => '1', ENDKEY => ''} 2024-02-27 02:54:49,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:49,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:54:49,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6c2a4b32c87492f2776e5464c461212, NAME => 'TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.', STARTKEY => '', ENDKEY => '1'} 2024-02-27 02:54:49,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 02:54:49,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,652 INFO [StoreOpener-48bef6aadbd622f536b9e765beca811c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,653 INFO [StoreOpener-c6c2a4b32c87492f2776e5464c461212-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,654 DEBUG [StoreOpener-48bef6aadbd622f536b9e765beca811c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c/cf 2024-02-27 02:54:49,654 DEBUG [StoreOpener-48bef6aadbd622f536b9e765beca811c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c/cf 2024-02-27 02:54:49,655 INFO [StoreOpener-48bef6aadbd622f536b9e765beca811c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48bef6aadbd622f536b9e765beca811c columnFamilyName cf 2024-02-27 02:54:49,655 DEBUG [StoreOpener-c6c2a4b32c87492f2776e5464c461212-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212/cf 2024-02-27 02:54:49,655 DEBUG [StoreOpener-c6c2a4b32c87492f2776e5464c461212-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212/cf 2024-02-27 02:54:49,656 INFO [StoreOpener-48bef6aadbd622f536b9e765beca811c-1] regionserver.HStore(310): Store=48bef6aadbd622f536b9e765beca811c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:49,657 INFO [StoreOpener-c6c2a4b32c87492f2776e5464c461212-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6c2a4b32c87492f2776e5464c461212 columnFamilyName cf 2024-02-27 02:54:49,658 INFO [StoreOpener-c6c2a4b32c87492f2776e5464c461212-1] regionserver.HStore(310): Store=c6c2a4b32c87492f2776e5464c461212/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 02:54:49,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 48bef6aadbd622f536b9e765beca811c 2024-02-27 02:54:49,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:54:49,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:49,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 48bef6aadbd622f536b9e765beca811c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60656579, jitterRate=-0.09614653885364532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 02:54:49,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 48bef6aadbd622f536b9e765beca811c: 2024-02-27 02:54:49,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c., pid=25, masterSystemTime=1709002489643 2024-02-27 02:54:49,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 02:54:49,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c6c2a4b32c87492f2776e5464c461212; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65004656, jitterRate=-0.03135514259338379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 02:54:49,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c6c2a4b32c87492f2776e5464c461212: 2024-02-27 02:54:49,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212., pid=26, masterSystemTime=1709002489645 2024-02-27 02:54:49,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:54:49,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:54:49,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=48bef6aadbd622f536b9e765beca811c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:54:49,674 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002489674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709002489674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709002489674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709002489674"}]},"ts":"1709002489674"} 2024-02-27 02:54:49,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:54:49,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:54:49,677 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c6c2a4b32c87492f2776e5464c461212, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:54:49,678 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002489677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709002489677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709002489677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709002489677"}]},"ts":"1709002489677"} 2024-02-27 02:54:49,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-02-27 02:54:49,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 48bef6aadbd622f536b9e765beca811c, server=jenkins-hbase4.apache.org,40779,1709002483314 in 188 msec 2024-02-27 02:54:49,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-02-27 02:54:49,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure c6c2a4b32c87492f2776e5464c461212, server=jenkins-hbase4.apache.org,45281,1709002483366 in 189 msec 2024-02-27 02:54:49,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=48bef6aadbd622f536b9e765beca811c, ASSIGN in 351 msec 2024-02-27 02:54:49,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-02-27 02:54:49,688 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=c6c2a4b32c87492f2776e5464c461212, ASSIGN in 354 msec 2024-02-27 02:54:49,689 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 02:54:49,689 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002489689"}]},"ts":"1709002489689"} 2024-02-27 02:54:49,691 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-02-27 02:54:49,694 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 02:54:49,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 448 msec 2024-02-27 02:54:50,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-27 02:54:50,005 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-02-27 02:54:50,005 DEBUG [Listener at localhost/35297] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-02-27 02:54:50,005 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:50,010 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-02-27 02:54:50,010 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:50,011 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-02-27 02:54:50,011 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:50,059 INFO [Listener at localhost/35297] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=309, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=168, AvailableMemoryMB=10117 2024-02-27 02:54:50,364 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:50,364 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:54:50,364 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709006090112 bypass), TestNs=QuotaState(ts=1709006090112 bypass)} 2024-02-27 02:54:50,364 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709006090112 bypass), TestQuotaAdmin2=QuotaState(ts=1709006090112 bypass), TestQuotaAdmin1=QuotaState(ts=1709006090112 bypass)} 2024-02-27 02:54:50,364 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709006090112 [ TestNs:TestTable ])} 2024-02-27 02:54:50,364 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709006090112 bypass)} 2024-02-27 02:54:50,607 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-02-27 02:54:50,615 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:54:50,615 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:54:50,615 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709006090112 bypass), TestNs=QuotaState(ts=1709006090112 bypass)} 2024-02-27 02:54:50,615 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709006090112 bypass), TestNs:TestTable=QuotaState(ts=1709006090112 bypass)} 2024-02-27 02:54:50,615 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709006090112 [ TestNs:TestTable ])} 2024-02-27 02:54:50,615 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709006090112 bypass)} 2024-02-27 02:54:50,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:50,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002500634, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:50,679 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-02-27 02:54:50,680 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-02-27 02:54:50,681 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-02-27 02:54:50,681 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-02-27 02:54:50,682 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-02-27 02:54:50,683 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-02-27 02:54:50,684 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-02-27 02:54:50,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:50,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002500634, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:51,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:51,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002500634, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:52,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:52,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002500634, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:52,233 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-02-27 02:54:52,234 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-02-27 02:54:52,234 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-02-27 02:54:52,235 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-02-27 02:54:53,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:53,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002500634, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:55,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:55,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002500634, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:55,963 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10365: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c., hostname=jenkins-hbase4.apache.org,40779,1709002483314, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:54:55,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:55,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44956 deadline: 1709002505966, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:56,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:56,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44956 deadline: 1709002505967, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:56,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:56,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44956 deadline: 1709002505966, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:57,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:57,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44956 deadline: 1709002505966, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:58,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:54:58,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44956 deadline: 1709002505967, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:01,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:01,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44956 deadline: 1709002505966, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:01,265 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10345: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c., hostname=jenkins-hbase4.apache.org,40779,1709002483314, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:01,525 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:01,525 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:01,525 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709009690112 bypass), TestNs=QuotaState(ts=1709009690112 bypass)} 2024-02-27 02:55:01,525 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709009690112 bypass), TestQuotaAdmin2=QuotaState(ts=1709009690112 bypass), TestQuotaAdmin1=QuotaState(ts=1709009690112 bypass)} 2024-02-27 02:55:01,525 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709009690112 bypass)} 2024-02-27 02:55:01,525 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709009690112 bypass)} 2024-02-27 02:55:01,776 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:01,776 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:01,776 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709009690112 bypass), TestNs=QuotaState(ts=1709009690112 bypass)} 2024-02-27 02:55:01,776 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709009690112 bypass), TestNs:TestTable=QuotaState(ts=1709009690112 bypass)} 2024-02-27 02:55:01,776 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709009690112 bypass)} 2024-02-27 02:55:01,776 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709009690112 bypass)} 2024-02-27 02:55:01,793 INFO [Listener at localhost/35297] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=292 (was 309), OpenFileDescriptor=601 (was 626), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=240 (was 280), ProcessCount=168 (was 168), AvailableMemoryMB=10063 (was 10117) 2024-02-27 02:55:01,807 INFO [Listener at localhost/35297] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=240, ProcessCount=168, AvailableMemoryMB=10061 2024-02-27 02:55:02,072 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:02,072 INFO [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-27 02:55:02,323 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:02,324 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709013290212 bypass), TestNs=QuotaState(ts=1709013290212 bypass)} 2024-02-27 02:55:02,325 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709013290212 bypass), TestQuotaAdmin2=QuotaState(ts=1709013290212 bypass), TestQuotaAdmin1=QuotaState(ts=1709013290212 bypass)} 2024-02-27 02:55:02,325 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709013290212 [ default ])} 2024-02-27 02:55:02,325 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709013290212 bypass)} 2024-02-27 02:55:02,576 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:02,576 INFO [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-27 02:55:02,826 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:02,827 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709013290312 bypass), TestNs=QuotaState(ts=1709013290312 bypass)} 2024-02-27 02:55:02,829 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709013290312 bypass), TestNs:TestTable=QuotaState(ts=1709013290312 bypass)} 2024-02-27 02:55:02,829 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709013290312 [ default ])} 2024-02-27 02:55:02,829 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709013290312 bypass)} 2024-02-27 02:55:02,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:02,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:47910 deadline: 1709002512839, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:03,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:03,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:47910 deadline: 1709002512840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:03,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:03,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:47910 deadline: 1709002512840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:04,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:04,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002512839, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:05,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:05,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002512840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:08,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:08,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002512840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:08,150 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10339: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda., hostname=jenkins-hbase4.apache.org,45281,1709002483366, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:08,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:08,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002518170, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:08,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:08,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002518170, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:08,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:08,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002518171, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:09,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:09,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002518171, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:10,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002518171, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:13,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:13,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002518170, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:13,468 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10320: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda., hostname=jenkins-hbase4.apache.org,45281,1709002483366, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:13,726 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:13,727 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:13,727 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709016890312 bypass), TestNs=QuotaState(ts=1709016890312 bypass)} 2024-02-27 02:55:13,727 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709016890312 bypass), TestQuotaAdmin2=QuotaState(ts=1709016890312 bypass), TestQuotaAdmin1=QuotaState(ts=1709016890312 bypass)} 2024-02-27 02:55:13,727 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709016890312 bypass)} 2024-02-27 02:55:13,727 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709016890312 bypass)} 2024-02-27 02:55:13,977 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:13,978 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:13,978 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709016890312 bypass), TestNs=QuotaState(ts=1709016890312 bypass)} 2024-02-27 02:55:13,978 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709016890312 bypass), TestNs:TestTable=QuotaState(ts=1709016890312 bypass)} 2024-02-27 02:55:13,978 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709016890312 bypass)} 2024-02-27 02:55:13,978 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709016890312 bypass)} 2024-02-27 02:55:13,992 INFO [Listener at localhost/35297] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292 (was 292), OpenFileDescriptor=597 (was 601), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 240), ProcessCount=168 (was 168), AvailableMemoryMB=10066 (was 10061) - AvailableMemoryMB LEAK? - 2024-02-27 02:55:14,006 INFO [Listener at localhost/35297] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=292, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=168, AvailableMemoryMB=10065 2024-02-27 02:55:14,269 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:14,269 INFO [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-27 02:55:14,520 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:14,521 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709020490412 bypass), TestNs=QuotaState(ts=1709020490412 bypass)} 2024-02-27 02:55:14,522 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709020490412 bypass), TestQuotaAdmin2=QuotaState(ts=1709020490412 bypass), TestQuotaAdmin1=QuotaState(ts=1709020490412 bypass)} 2024-02-27 02:55:14,522 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709020490412 global-limiter)} 2024-02-27 02:55:14,522 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709020490412 bypass)} 2024-02-27 02:55:14,772 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:14,773 INFO [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-27 02:55:15,023 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:15,024 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709020490512 bypass), TestNs=QuotaState(ts=1709020490512 bypass)} 2024-02-27 02:55:15,025 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709020490512 bypass), TestNs:TestTable=QuotaState(ts=1709020490512 bypass)} 2024-02-27 02:55:15,025 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709020490512 global-limiter)} 2024-02-27 02:55:15,025 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709020490512 bypass)} 2024-02-27 02:55:15,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:15,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002525041, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:15,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:15,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002525042, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:15,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:15,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002525042, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:16,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:16,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002525042, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:17,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:17,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002525041, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:20,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:20,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002525042, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:20,343 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10335: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda., hostname=jenkins-hbase4.apache.org,45281,1709002483366, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:20,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:20,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002530351, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:20,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:20,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002530350, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:21,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:21,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002530350, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:21,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:21,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002530351, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:23,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:23,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002530351, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:25,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:25,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002530350, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 02:55:25,659 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10319: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda., hostname=jenkins-hbase4.apache.org,45281,1709002483366, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:25,915 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:25,915 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:25,915 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709024090512 bypass), TestNs=QuotaState(ts=1709024090512 bypass)} 2024-02-27 02:55:25,915 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709024090512 bypass), TestQuotaAdmin2=QuotaState(ts=1709024090512 bypass), TestQuotaAdmin1=QuotaState(ts=1709024090512 bypass)} 2024-02-27 02:55:25,915 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709024090512 bypass)} 2024-02-27 02:55:25,915 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709024090512 bypass)} 2024-02-27 02:55:26,166 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:26,166 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:26,166 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709024090512 bypass), TestNs=QuotaState(ts=1709024090512 bypass)} 2024-02-27 02:55:26,166 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709024090512 bypass), TestNs:TestTable=QuotaState(ts=1709024090512 bypass)} 2024-02-27 02:55:26,166 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709024090512 bypass)} 2024-02-27 02:55:26,166 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709024090512 bypass)} 2024-02-27 02:55:26,179 INFO [Listener at localhost/35297] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=283 (was 292), OpenFileDescriptor=595 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 219), ProcessCount=168 (was 168), AvailableMemoryMB=10658 (was 10065) - AvailableMemoryMB LEAK? - 2024-02-27 02:55:26,192 INFO [Listener at localhost/35297] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=283, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=184, ProcessCount=168, AvailableMemoryMB=10657 2024-02-27 02:55:26,449 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:26,450 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:26,450 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709027690512 bypass), TestNs=QuotaState(ts=1709027690512 bypass)} 2024-02-27 02:55:26,452 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709027690512 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1709027690512 bypass), TestQuotaAdmin1=QuotaState(ts=1709027690512 bypass)} 2024-02-27 02:55:26,452 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 02:55:26,453 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709027690512 bypass)} 2024-02-27 02:55:26,703 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:26,704 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:26,704 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709027690512 bypass), TestNs=QuotaState(ts=1709027690512 bypass)} 2024-02-27 02:55:26,704 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709027690512 bypass), TestNs:TestTable=QuotaState(ts=1709027690512 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000)))} 2024-02-27 02:55:26,704 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 02:55:26,704 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709027690512 bypass)} 2024-02-27 02:55:26,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:26,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44956 deadline: 1709002536719, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:26,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:26,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44956 deadline: 1709002536718, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:27,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:27,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44956 deadline: 1709002536718, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:28,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:28,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44956 deadline: 1709002536719, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:29,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:29,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44956 deadline: 1709002536718, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:32,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:32,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44956 deadline: 1709002536718, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:32,011 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10341: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c., hostname=jenkins-hbase4.apache.org,40779,1709002483314, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:32,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:32,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002542013, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:32,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:32,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002542013, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:32,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:32,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002542012, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:33,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:33,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002542012, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:34,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:34,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002542013, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:37,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:37,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40779] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44956 deadline: 1709002542012, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 02:55:37,300 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10313: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c., hostname=jenkins-hbase4.apache.org,40779,1709002483314, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:37,559 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:37,559 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:37,559 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709031290512 bypass), TestNs=QuotaState(ts=1709031290512 bypass)} 2024-02-27 02:55:37,559 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709031290512 bypass), TestQuotaAdmin2=QuotaState(ts=1709031290512 bypass), TestQuotaAdmin1=QuotaState(ts=1709031290512 bypass)} 2024-02-27 02:55:37,559 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709031290512 bypass)} 2024-02-27 02:55:37,559 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709031290512 bypass)} 2024-02-27 02:55:37,810 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:37,810 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:37,810 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709031290512 bypass), TestNs=QuotaState(ts=1709031290512 bypass)} 2024-02-27 02:55:37,810 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709031290512 bypass), TestNs:TestTable=QuotaState(ts=1709031290512 bypass)} 2024-02-27 02:55:37,810 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 02:55:37,810 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709031290512 bypass)} 2024-02-27 02:55:37,827 INFO [Listener at localhost/35297] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282 (was 283), OpenFileDescriptor=595 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 184), ProcessCount=168 (was 168), AvailableMemoryMB=10542 (was 10657) 2024-02-27 02:55:37,841 INFO [Listener at localhost/35297] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=282, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=168, AvailableMemoryMB=10540 2024-02-27 02:55:38,103 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:38,104 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:38,105 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709034890512 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1709034890512 bypass)} 2024-02-27 02:55:38,105 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709034890512 bypass), TestQuotaAdmin2=QuotaState(ts=1709034890512 bypass), TestQuotaAdmin1=QuotaState(ts=1709034890512 bypass)} 2024-02-27 02:55:38,105 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 02:55:38,105 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709034890512 bypass)} 2024-02-27 02:55:38,355 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:38,355 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:38,357 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709034890512 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1709034890512 bypass)} 2024-02-27 02:55:38,357 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709034890512 bypass), TestNs:TestTable=QuotaState(ts=1709034890512 bypass)} 2024-02-27 02:55:38,357 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 02:55:38,357 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709034890512 bypass)} 2024-02-27 02:55:38,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:38,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002548373, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:38,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:38,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002548373, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:39,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:39,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002548372, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:39,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:39,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002548373, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:41,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:41,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002548373, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:43,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:43,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47910 deadline: 1709002548373, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 02:55:43,667 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10319: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda., hostname=jenkins-hbase4.apache.org,45281,1709002483366, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:43,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:43,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002553677, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:43,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:43,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002553677, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:44,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:44,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002553677, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:45,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:45,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002553676, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:46,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:46,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002553676, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:48,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:48,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45281] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47910 deadline: 1709002553677, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 02:55:48,963 ERROR [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10299: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda., hostname=jenkins-hbase4.apache.org,45281,1709002483366, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 02:55:49,222 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:49,222 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:49,222 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709038490512 bypass), TestNs=QuotaState(ts=1709038490512 bypass)} 2024-02-27 02:55:49,222 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709038490512 bypass), TestQuotaAdmin2=QuotaState(ts=1709038490512 bypass), TestQuotaAdmin1=QuotaState(ts=1709038490512 bypass)} 2024-02-27 02:55:49,222 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 02:55:49,222 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709038490512 bypass)} 2024-02-27 02:55:49,472 INFO [Listener at localhost/35297] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 02:55:49,473 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 02:55:49,473 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709038490512 bypass), TestNs=QuotaState(ts=1709038490512 bypass)} 2024-02-27 02:55:49,473 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709038490512 bypass), TestNs:TestTable=QuotaState(ts=1709038490512 bypass)} 2024-02-27 02:55:49,473 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709038490512 bypass)} 2024-02-27 02:55:49,473 DEBUG [Listener at localhost/35297] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709038490512 bypass)} 2024-02-27 02:55:49,486 INFO [Listener at localhost/35297] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=267 (was 282), OpenFileDescriptor=583 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=132 (was 156), ProcessCount=168 (was 168), AvailableMemoryMB=10000 (was 10540) 2024-02-27 02:55:49,489 INFO [Listener at localhost/35297] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-02-27 02:55:49,493 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-02-27 02:55:49,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-02-27 02:55:49,505 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002549504"}]},"ts":"1709002549504"} 2024-02-27 02:55:49,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-27 02:55:49,507 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-02-27 02:55:49,509 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-02-27 02:55:49,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cbdc153023ab614cfd623baf4d038bda, UNASSIGN}] 2024-02-27 02:55:49,512 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cbdc153023ab614cfd623baf4d038bda, UNASSIGN 2024-02-27 02:55:49,513 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cbdc153023ab614cfd623baf4d038bda, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:55:49,513 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002549513"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002549513"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002549513"}]},"ts":"1709002549513"} 2024-02-27 02:55:49,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure cbdc153023ab614cfd623baf4d038bda, server=jenkins-hbase4.apache.org,45281,1709002483366}] 2024-02-27 02:55:49,646 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,45281,1709002483366, timeout=1709002549672, delay=26, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure cbdc153023ab614cfd623baf4d038bda, server=jenkins-hbase4.apache.org,45281,1709002483366]] 2024-02-27 02:55:49,674 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:55:49,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:55:49,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cbdc153023ab614cfd623baf4d038bda, disabling compactions & flushes 2024-02-27 02:55:49,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:55:49,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:55:49,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. after waiting 0 ms 2024-02-27 02:55:49,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:55:49,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cbdc153023ab614cfd623baf4d038bda 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-02-27 02:55:49,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/.tmp/cf/99f4aea4d8944f06bb70adfd5bf3d2c6 2024-02-27 02:55:49,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-27 02:55:49,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/.tmp/cf/99f4aea4d8944f06bb70adfd5bf3d2c6 as hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/cf/99f4aea4d8944f06bb70adfd5bf3d2c6 2024-02-27 02:55:49,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/cf/99f4aea4d8944f06bb70adfd5bf3d2c6, entries=6, sequenceid=21, filesize=4.7 K 2024-02-27 02:55:49,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for cbdc153023ab614cfd623baf4d038bda in 134ms, sequenceid=21, compaction requested=false 2024-02-27 02:55:49,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-02-27 02:55:49,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda. 2024-02-27 02:55:49,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cbdc153023ab614cfd623baf4d038bda: 2024-02-27 02:55:49,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:55:49,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cbdc153023ab614cfd623baf4d038bda, regionState=CLOSED 2024-02-27 02:55:49,827 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002549826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002549826"}]},"ts":"1709002549826"} 2024-02-27 02:55:49,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-02-27 02:55:49,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure cbdc153023ab614cfd623baf4d038bda, server=jenkins-hbase4.apache.org,45281,1709002483366 in 313 msec 2024-02-27 02:55:49,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-02-27 02:55:49,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cbdc153023ab614cfd623baf4d038bda, UNASSIGN in 320 msec 2024-02-27 02:55:49,834 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002549834"}]},"ts":"1709002549834"} 2024-02-27 02:55:49,836 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-02-27 02:55:49,838 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-02-27 02:55:49,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 344 msec 2024-02-27 02:55:50,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-27 02:55:50,260 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-02-27 02:55:50,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-02-27 02:55:50,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 02:55:50,276 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 02:55:50,280 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 02:55:50,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-02-27 02:55:50,289 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:55:50,294 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/cf, FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/recovered.edits] 2024-02-27 02:55:50,304 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/cf/99f4aea4d8944f06bb70adfd5bf3d2c6 to hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/archive/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/cf/99f4aea4d8944f06bb70adfd5bf3d2c6 2024-02-27 02:55:50,312 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/recovered.edits/24.seqid to hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/archive/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda/recovered.edits/24.seqid 2024-02-27 02:55:50,314 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin0/cbdc153023ab614cfd623baf4d038bda 2024-02-27 02:55:50,314 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-02-27 02:55:50,319 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 02:55:50,345 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-02-27 02:55:50,349 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-02-27 02:55:50,352 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 02:55:50,352 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-02-27 02:55:50,352 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709002550352"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:50,355 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-27 02:55:50,355 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cbdc153023ab614cfd623baf4d038bda, NAME => 'TestQuotaAdmin0,,1709002486603.cbdc153023ab614cfd623baf4d038bda.', STARTKEY => '', ENDKEY => ''}] 2024-02-27 02:55:50,355 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-02-27 02:55:50,355 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709002550355"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:50,357 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-02-27 02:55:50,360 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 02:55:50,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 92 msec 2024-02-27 02:55:50,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-02-27 02:55:50,537 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-02-27 02:55:50,538 INFO [Listener at localhost/35297] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-02-27 02:55:50,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-02-27 02:55:50,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-02-27 02:55:50,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-02-27 02:55:50,544 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002550544"}]},"ts":"1709002550544"} 2024-02-27 02:55:50,546 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-02-27 02:55:50,548 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-02-27 02:55:50,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=71407bcf9331ea959ba1c3d5a2fa2be2, UNASSIGN}] 2024-02-27 02:55:50,551 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=71407bcf9331ea959ba1c3d5a2fa2be2, UNASSIGN 2024-02-27 02:55:50,552 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=71407bcf9331ea959ba1c3d5a2fa2be2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:55:50,552 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002550552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002550552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002550552"}]},"ts":"1709002550552"} 2024-02-27 02:55:50,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 71407bcf9331ea959ba1c3d5a2fa2be2, server=jenkins-hbase4.apache.org,40779,1709002483314}] 2024-02-27 02:55:50,706 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:55:50,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:55:50,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 71407bcf9331ea959ba1c3d5a2fa2be2, disabling compactions & flushes 2024-02-27 02:55:50,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:55:50,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:55:50,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. after waiting 0 ms 2024-02-27 02:55:50,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:55:50,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-27 02:55:50,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2. 2024-02-27 02:55:50,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 71407bcf9331ea959ba1c3d5a2fa2be2: 2024-02-27 02:55:50,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:55:50,720 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=71407bcf9331ea959ba1c3d5a2fa2be2, regionState=CLOSED 2024-02-27 02:55:50,720 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002550720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002550720"}]},"ts":"1709002550720"} 2024-02-27 02:55:50,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-02-27 02:55:50,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 71407bcf9331ea959ba1c3d5a2fa2be2, server=jenkins-hbase4.apache.org,40779,1709002483314 in 168 msec 2024-02-27 02:55:50,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-02-27 02:55:50,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=71407bcf9331ea959ba1c3d5a2fa2be2, UNASSIGN in 174 msec 2024-02-27 02:55:50,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002550727"}]},"ts":"1709002550727"} 2024-02-27 02:55:50,728 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-02-27 02:55:50,730 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-02-27 02:55:50,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 193 msec 2024-02-27 02:55:50,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-02-27 02:55:50,795 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-02-27 02:55:50,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-02-27 02:55:50,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 02:55:50,799 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 02:55:50,801 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 02:55:50,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-02-27 02:55:50,806 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:55:50,808 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2/cf, FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2/recovered.edits] 2024-02-27 02:55:50,817 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2/recovered.edits/4.seqid to hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/archive/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2/recovered.edits/4.seqid 2024-02-27 02:55:50,818 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin1/71407bcf9331ea959ba1c3d5a2fa2be2 2024-02-27 02:55:50,818 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-02-27 02:55:50,821 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 02:55:50,823 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-02-27 02:55:50,825 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-02-27 02:55:50,826 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 02:55:50,826 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-02-27 02:55:50,826 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709002550826"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:50,828 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-27 02:55:50,828 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 71407bcf9331ea959ba1c3d5a2fa2be2, NAME => 'TestQuotaAdmin1,,1709002487416.71407bcf9331ea959ba1c3d5a2fa2be2.', STARTKEY => '', ENDKEY => ''}] 2024-02-27 02:55:50,828 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-02-27 02:55:50,828 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709002550828"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:50,829 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-02-27 02:55:50,832 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 02:55:50,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 36 msec 2024-02-27 02:55:51,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-02-27 02:55:51,054 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-02-27 02:55:51,055 INFO [Listener at localhost/35297] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-02-27 02:55:51,055 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-02-27 02:55:51,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-02-27 02:55:51,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-02-27 02:55:51,060 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002551060"}]},"ts":"1709002551060"} 2024-02-27 02:55:51,062 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-02-27 02:55:51,064 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-02-27 02:55:51,065 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b3942222c94335d2a72a8bd8e3f0328d, UNASSIGN}] 2024-02-27 02:55:51,066 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b3942222c94335d2a72a8bd8e3f0328d, UNASSIGN 2024-02-27 02:55:51,067 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b3942222c94335d2a72a8bd8e3f0328d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:55:51,067 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002551067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002551067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002551067"}]},"ts":"1709002551067"} 2024-02-27 02:55:51,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure b3942222c94335d2a72a8bd8e3f0328d, server=jenkins-hbase4.apache.org,40779,1709002483314}] 2024-02-27 02:55:51,221 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:55:51,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:55:51,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b3942222c94335d2a72a8bd8e3f0328d, disabling compactions & flushes 2024-02-27 02:55:51,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:55:51,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:55:51,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. after waiting 0 ms 2024-02-27 02:55:51,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:55:51,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-27 02:55:51,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d. 2024-02-27 02:55:51,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b3942222c94335d2a72a8bd8e3f0328d: 2024-02-27 02:55:51,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:55:51,232 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b3942222c94335d2a72a8bd8e3f0328d, regionState=CLOSED 2024-02-27 02:55:51,232 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709002551232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002551232"}]},"ts":"1709002551232"} 2024-02-27 02:55:51,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-02-27 02:55:51,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure b3942222c94335d2a72a8bd8e3f0328d, server=jenkins-hbase4.apache.org,40779,1709002483314 in 165 msec 2024-02-27 02:55:51,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-02-27 02:55:51,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b3942222c94335d2a72a8bd8e3f0328d, UNASSIGN in 171 msec 2024-02-27 02:55:51,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002551239"}]},"ts":"1709002551239"} 2024-02-27 02:55:51,240 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-02-27 02:55:51,243 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-02-27 02:55:51,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 187 msec 2024-02-27 02:55:51,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-02-27 02:55:51,311 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-02-27 02:55:51,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-02-27 02:55:51,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 02:55:51,315 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 02:55:51,316 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 02:55:51,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-02-27 02:55:51,321 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:55:51,323 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d/cf, FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d/recovered.edits] 2024-02-27 02:55:51,332 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d/recovered.edits/4.seqid to hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/archive/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d/recovered.edits/4.seqid 2024-02-27 02:55:51,332 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/default/TestQuotaAdmin2/b3942222c94335d2a72a8bd8e3f0328d 2024-02-27 02:55:51,332 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-02-27 02:55:51,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 02:55:51,337 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-02-27 02:55:51,339 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-02-27 02:55:51,340 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 02:55:51,340 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-02-27 02:55:51,341 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709002551340"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:51,342 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-27 02:55:51,342 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b3942222c94335d2a72a8bd8e3f0328d, NAME => 'TestQuotaAdmin2,,1709002488200.b3942222c94335d2a72a8bd8e3f0328d.', STARTKEY => '', ENDKEY => ''}] 2024-02-27 02:55:51,342 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-02-27 02:55:51,342 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709002551342"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:51,344 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-02-27 02:55:51,347 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 02:55:51,348 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 35 msec 2024-02-27 02:55:51,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-02-27 02:55:51,570 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-02-27 02:55:51,570 INFO [Listener at localhost/35297] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-02-27 02:55:51,571 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-02-27 02:55:51,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-02-27 02:55:51,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-02-27 02:55:51,575 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002551575"}]},"ts":"1709002551575"} 2024-02-27 02:55:51,577 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-02-27 02:55:51,579 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-02-27 02:55:51,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=c6c2a4b32c87492f2776e5464c461212, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=48bef6aadbd622f536b9e765beca811c, UNASSIGN}] 2024-02-27 02:55:51,580 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=c6c2a4b32c87492f2776e5464c461212, UNASSIGN 2024-02-27 02:55:51,580 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=48bef6aadbd622f536b9e765beca811c, UNASSIGN 2024-02-27 02:55:51,581 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c6c2a4b32c87492f2776e5464c461212, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:55:51,581 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002551581"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002551581"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002551581"}]},"ts":"1709002551581"} 2024-02-27 02:55:51,581 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=48bef6aadbd622f536b9e765beca811c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:55:51,581 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002551581"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709002551581"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709002551581"}]},"ts":"1709002551581"} 2024-02-27 02:55:51,583 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure c6c2a4b32c87492f2776e5464c461212, server=jenkins-hbase4.apache.org,45281,1709002483366}] 2024-02-27 02:55:51,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure 48bef6aadbd622f536b9e765beca811c, server=jenkins-hbase4.apache.org,40779,1709002483314}] 2024-02-27 02:55:51,735 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:55:51,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:55:51,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c6c2a4b32c87492f2776e5464c461212, disabling compactions & flushes 2024-02-27 02:55:51,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:55:51,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:55:51,736 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:55:51,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. after waiting 0 ms 2024-02-27 02:55:51,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:55:51,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 48bef6aadbd622f536b9e765beca811c 2024-02-27 02:55:51,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 48bef6aadbd622f536b9e765beca811c, disabling compactions & flushes 2024-02-27 02:55:51,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:55:51,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:55:51,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. after waiting 0 ms 2024-02-27 02:55:51,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:55:51,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-27 02:55:51,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-27 02:55:51,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212. 2024-02-27 02:55:51,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c6c2a4b32c87492f2776e5464c461212: 2024-02-27 02:55:51,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c. 2024-02-27 02:55:51,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 48bef6aadbd622f536b9e765beca811c: 2024-02-27 02:55:51,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:55:51,747 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c6c2a4b32c87492f2776e5464c461212, regionState=CLOSED 2024-02-27 02:55:51,747 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002551747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002551747"}]},"ts":"1709002551747"} 2024-02-27 02:55:51,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 48bef6aadbd622f536b9e765beca811c 2024-02-27 02:55:51,748 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=48bef6aadbd622f536b9e765beca811c, regionState=CLOSED 2024-02-27 02:55:51,748 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709002551748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709002551748"}]},"ts":"1709002551748"} 2024-02-27 02:55:51,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-02-27 02:55:51,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure c6c2a4b32c87492f2776e5464c461212, server=jenkins-hbase4.apache.org,45281,1709002483366 in 165 msec 2024-02-27 02:55:51,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-02-27 02:55:51,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure 48bef6aadbd622f536b9e765beca811c, server=jenkins-hbase4.apache.org,40779,1709002483314 in 165 msec 2024-02-27 02:55:51,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=c6c2a4b32c87492f2776e5464c461212, UNASSIGN in 172 msec 2024-02-27 02:55:51,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-02-27 02:55:51,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=48bef6aadbd622f536b9e765beca811c, UNASSIGN in 173 msec 2024-02-27 02:55:51,755 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709002551755"}]},"ts":"1709002551755"} 2024-02-27 02:55:51,756 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-02-27 02:55:51,759 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-02-27 02:55:51,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 188 msec 2024-02-27 02:55:51,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-02-27 02:55:51,826 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-02-27 02:55:51,827 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-02-27 02:55:51,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 02:55:51,829 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 02:55:51,830 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 02:55:51,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-02-27 02:55:51,836 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:55:51,836 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c 2024-02-27 02:55:51,839 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212/cf, FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212/recovered.edits] 2024-02-27 02:55:51,839 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c/cf, FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c/recovered.edits] 2024-02-27 02:55:51,847 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212/recovered.edits/4.seqid to hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/archive/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212/recovered.edits/4.seqid 2024-02-27 02:55:51,847 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c/recovered.edits/4.seqid to hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/archive/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c/recovered.edits/4.seqid 2024-02-27 02:55:51,847 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/c6c2a4b32c87492f2776e5464c461212 2024-02-27 02:55:51,848 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/.tmp/data/TestNs/TestTable/48bef6aadbd622f536b9e765beca811c 2024-02-27 02:55:51,848 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-02-27 02:55:51,851 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 02:55:51,853 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-02-27 02:55:51,855 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-02-27 02:55:51,856 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 02:55:51,856 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-02-27 02:55:51,856 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709002551856"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:51,856 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709002551856"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:51,858 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-02-27 02:55:51,858 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c6c2a4b32c87492f2776e5464c461212, NAME => 'TestNs:TestTable,,1709002489245.c6c2a4b32c87492f2776e5464c461212.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 48bef6aadbd622f536b9e765beca811c, NAME => 'TestNs:TestTable,1,1709002489245.48bef6aadbd622f536b9e765beca811c.', STARTKEY => '1', ENDKEY => ''}] 2024-02-27 02:55:51,858 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-02-27 02:55:51,858 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709002551858"}]},"ts":"9223372036854775807"} 2024-02-27 02:55:51,860 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-02-27 02:55:51,863 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 02:55:51,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 36 msec 2024-02-27 02:55:52,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-02-27 02:55:52,084 INFO [Listener at localhost/35297] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-02-27 02:55:52,088 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-02-27 02:55:52,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 02:55:52,097 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 02:55:52,099 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 02:55:52,101 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 02:55:52,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-02-27 02:55:52,103 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-02-27 02:55:52,103 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-27 02:55:52,104 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 02:55:52,106 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 02:55:52,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 17 msec 2024-02-27 02:55:52,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42961] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-02-27 02:55:52,353 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-02-27 02:55:52,354 INFO [Listener at localhost/35297] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-27 02:55:52,354 DEBUG [Listener at localhost/35297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x141fbce7 to 127.0.0.1:63173 2024-02-27 02:55:52,354 DEBUG [Listener at localhost/35297] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 02:55:52,355 DEBUG [Listener at localhost/35297] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-02-27 02:55:52,355 DEBUG [Listener at localhost/35297] util.JVMClusterUtil(257): Found active master hash=436039110, stopped=false 2024-02-27 02:55:52,355 DEBUG [Listener at localhost/35297] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-02-27 02:55:52,355 INFO [Listener at localhost/35297] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:55:52,358 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-27 02:55:52,358 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-27 02:55:52,358 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-27 02:55:52,358 INFO [Listener at localhost/35297] procedure2.ProcedureExecutor(675): Stopping 2024-02-27 02:55:52,358 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:55:52,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 02:55:52,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 02:55:52,358 DEBUG [Listener at localhost/35297] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bac309a to 127.0.0.1:63173 2024-02-27 02:55:52,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 02:55:52,359 DEBUG [Listener at localhost/35297] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 02:55:52,359 INFO [Listener at localhost/35297] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,40779,1709002483314' ***** 2024-02-27 02:55:52,359 INFO [Listener at localhost/35297] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-02-27 02:55:52,359 INFO [Listener at localhost/35297] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,45281,1709002483366' ***** 2024-02-27 02:55:52,359 INFO [Listener at localhost/35297] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-02-27 02:55:52,359 INFO [RS:0;jenkins-hbase4:40779] regionserver.HeapMemoryManager(220): Stopping 2024-02-27 02:55:52,359 INFO [RS:0;jenkins-hbase4:40779] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-02-27 02:55:52,359 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-02-27 02:55:52,360 INFO [RS:0;jenkins-hbase4:40779] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-02-27 02:55:52,360 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(3307): Received CLOSE for 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:55:52,360 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:55:52,360 INFO [RS:0;jenkins-hbase4:40779] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-27 02:55:52,360 DEBUG [RS:0;jenkins-hbase4:40779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d883c93 to 127.0.0.1:63173 2024-02-27 02:55:52,359 INFO [RS:1;jenkins-hbase4:45281] regionserver.HeapMemoryManager(220): Stopping 2024-02-27 02:55:52,361 DEBUG [RS:0;jenkins-hbase4:40779] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 02:55:52,361 INFO [RS:1;jenkins-hbase4:45281] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-02-27 02:55:52,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c657e623e20e030ae9ece5671d02a4a, disabling compactions & flushes 2024-02-27 02:55:52,359 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-02-27 02:55:52,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:55:52,362 INFO [RS:1;jenkins-hbase4:45281] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-02-27 02:55:52,362 INFO [RS:0;jenkins-hbase4:40779] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-02-27 02:55:52,362 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(3307): Received CLOSE for d26724700b807a345a15af1d04fb898e 2024-02-27 02:55:52,362 INFO [RS:0;jenkins-hbase4:40779] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-02-27 02:55:52,362 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:55:52,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:55:52,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d26724700b807a345a15af1d04fb898e, disabling compactions & flushes 2024-02-27 02:55:52,362 INFO [RS:1;jenkins-hbase4:45281] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-27 02:55:52,362 INFO [RS:0;jenkins-hbase4:40779] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-02-27 02:55:52,363 DEBUG [RS:1;jenkins-hbase4:45281] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f7ba3fa to 127.0.0.1:63173 2024-02-27 02:55:52,363 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-02-27 02:55:52,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:55:52,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. after waiting 0 ms 2024-02-27 02:55:52,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:55:52,363 DEBUG [RS:1;jenkins-hbase4:45281] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 02:55:52,363 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-02-27 02:55:52,363 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-02-27 02:55:52,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-02-27 02:55:52,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. after waiting 0 ms 2024-02-27 02:55:52,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:55:52,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:55:52,364 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-02-27 02:55:52,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d26724700b807a345a15af1d04fb898e 1/1 column families, dataSize=147 B heapSize=704 B 2024-02-27 02:55:52,364 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1481): Online Regions={d26724700b807a345a15af1d04fb898e=hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e.} 2024-02-27 02:55:52,363 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1481): Online Regions={7c657e623e20e030ae9ece5671d02a4a=hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a., 1588230740=hbase:meta,,1.1588230740} 2024-02-27 02:55:52,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-02-27 02:55:52,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7c657e623e20e030ae9ece5671d02a4a 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-02-27 02:55:52,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-02-27 02:55:52,364 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-02-27 02:55:52,364 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-02-27 02:55:52,366 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1507): Waiting on 1588230740, 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:55:52,366 DEBUG [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1507): Waiting on d26724700b807a345a15af1d04fb898e 2024-02-27 02:55:52,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/.tmp/info/d4f4fcf1df964095979bf62b5969ed4d 2024-02-27 02:55:52,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e/.tmp/info/b1b1ef31169340acb6ff5132836b01e1 2024-02-27 02:55:52,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/.tmp/q/dffcc99e234f411b97eac397d0df364d 2024-02-27 02:55:52,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4f4fcf1df964095979bf62b5969ed4d 2024-02-27 02:55:52,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1b1ef31169340acb6ff5132836b01e1 2024-02-27 02:55:52,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dffcc99e234f411b97eac397d0df364d 2024-02-27 02:55:52,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e/.tmp/info/b1b1ef31169340acb6ff5132836b01e1 as hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e/info/b1b1ef31169340acb6ff5132836b01e1 2024-02-27 02:55:52,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1b1ef31169340acb6ff5132836b01e1 2024-02-27 02:55:52,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e/info/b1b1ef31169340acb6ff5132836b01e1, entries=3, sequenceid=8, filesize=5.0 K 2024-02-27 02:55:52,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for d26724700b807a345a15af1d04fb898e in 79ms, sequenceid=8, compaction requested=false 2024-02-27 02:55:52,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/namespace/d26724700b807a345a15af1d04fb898e/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-02-27 02:55:52,453 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/.tmp/rep_barrier/b86f7c12f7de402c972c3a5d30c81cf9 2024-02-27 02:55:52,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:55:52,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d26724700b807a345a15af1d04fb898e: 2024-02-27 02:55:52,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1709002485306.d26724700b807a345a15af1d04fb898e. 2024-02-27 02:55:52,459 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-02-27 02:55:52,459 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-02-27 02:55:52,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b86f7c12f7de402c972c3a5d30c81cf9 2024-02-27 02:55:52,479 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/.tmp/table/56c3e7132752461a96a2de22f6b17d1f 2024-02-27 02:55:52,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56c3e7132752461a96a2de22f6b17d1f 2024-02-27 02:55:52,488 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/.tmp/info/d4f4fcf1df964095979bf62b5969ed4d as hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/info/d4f4fcf1df964095979bf62b5969ed4d 2024-02-27 02:55:52,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4f4fcf1df964095979bf62b5969ed4d 2024-02-27 02:55:52,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/info/d4f4fcf1df964095979bf62b5969ed4d, entries=30, sequenceid=66, filesize=8.0 K 2024-02-27 02:55:52,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/.tmp/rep_barrier/b86f7c12f7de402c972c3a5d30c81cf9 as hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/rep_barrier/b86f7c12f7de402c972c3a5d30c81cf9 2024-02-27 02:55:52,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b86f7c12f7de402c972c3a5d30c81cf9 2024-02-27 02:55:52,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/rep_barrier/b86f7c12f7de402c972c3a5d30c81cf9, entries=5, sequenceid=66, filesize=5.3 K 2024-02-27 02:55:52,508 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/.tmp/table/56c3e7132752461a96a2de22f6b17d1f as hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/table/56c3e7132752461a96a2de22f6b17d1f 2024-02-27 02:55:52,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56c3e7132752461a96a2de22f6b17d1f 2024-02-27 02:55:52,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/table/56c3e7132752461a96a2de22f6b17d1f, entries=13, sequenceid=66, filesize=5.6 K 2024-02-27 02:55:52,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 153ms, sequenceid=66, compaction requested=false 2024-02-27 02:55:52,527 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-02-27 02:55:52,527 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-02-27 02:55:52,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-02-27 02:55:52,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-02-27 02:55:52,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-02-27 02:55:52,566 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,45281,1709002483366; all regions closed. 2024-02-27 02:55:52,566 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1507): Waiting on 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:55:52,566 DEBUG [RS:1;jenkins-hbase4:45281] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-02-27 02:55:52,576 DEBUG [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/oldWALs 2024-02-27 02:55:52,576 INFO [RS:1;jenkins-hbase4:45281] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45281%2C1709002483366:(num 1709002484864) 2024-02-27 02:55:52,576 DEBUG [RS:1;jenkins-hbase4:45281] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 02:55:52,576 INFO [RS:1;jenkins-hbase4:45281] regionserver.LeaseManager(133): Closed leases 2024-02-27 02:55:52,577 INFO [RS:1;jenkins-hbase4:45281] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-02-27 02:55:52,577 INFO [RS:1;jenkins-hbase4:45281] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-02-27 02:55:52,577 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-27 02:55:52,577 INFO [RS:1;jenkins-hbase4:45281] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-02-27 02:55:52,577 INFO [RS:1;jenkins-hbase4:45281] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-02-27 02:55:52,578 INFO [RS:1;jenkins-hbase4:45281] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45281 2024-02-27 02:55:52,584 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 02:55:52,584 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:55:52,584 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45281,1709002483366 2024-02-27 02:55:52,584 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 02:55:52,584 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 02:55:52,585 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45281,1709002483366] 2024-02-27 02:55:52,585 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45281,1709002483366; numProcessing=1 2024-02-27 02:55:52,587 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45281,1709002483366 already deleted, retry=false 2024-02-27 02:55:52,587 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,45281,1709002483366 expired; onlineServers=1 2024-02-27 02:55:52,686 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 02:55:52,686 INFO [RS:1;jenkins-hbase4:45281] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,45281,1709002483366; zookeeper connection closed. 2024-02-27 02:55:52,686 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:45281-0x1000ddd257b0002, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 02:55:52,686 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42bc327a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42bc327a 2024-02-27 02:55:52,698 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2024-02-27 02:55:52,699 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2024-02-27 02:55:52,766 DEBUG [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1507): Waiting on 7c657e623e20e030ae9ece5671d02a4a 2024-02-27 02:55:52,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/.tmp/u/07863d3c13524305a3f828a3ac47fae4 2024-02-27 02:55:52,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07863d3c13524305a3f828a3ac47fae4 2024-02-27 02:55:52,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/.tmp/q/dffcc99e234f411b97eac397d0df364d as hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/q/dffcc99e234f411b97eac397d0df364d 2024-02-27 02:55:52,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dffcc99e234f411b97eac397d0df364d 2024-02-27 02:55:52,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/q/dffcc99e234f411b97eac397d0df364d, entries=5, sequenceid=17, filesize=5.1 K 2024-02-27 02:55:52,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/.tmp/u/07863d3c13524305a3f828a3ac47fae4 as hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/u/07863d3c13524305a3f828a3ac47fae4 2024-02-27 02:55:52,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07863d3c13524305a3f828a3ac47fae4 2024-02-27 02:55:52,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/u/07863d3c13524305a3f828a3ac47fae4, entries=4, sequenceid=17, filesize=5.0 K 2024-02-27 02:55:52,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 7c657e623e20e030ae9ece5671d02a4a in 515ms, sequenceid=17, compaction requested=false 2024-02-27 02:55:52,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/data/hbase/quota/7c657e623e20e030ae9ece5671d02a4a/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-02-27 02:55:52,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:55:52,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c657e623e20e030ae9ece5671d02a4a: 2024-02-27 02:55:52,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1709002486026.7c657e623e20e030ae9ece5671d02a4a. 2024-02-27 02:55:52,967 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,40779,1709002483314; all regions closed. 2024-02-27 02:55:52,967 DEBUG [RS:0;jenkins-hbase4:40779] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-02-27 02:55:52,974 DEBUG [RS:0;jenkins-hbase4:40779] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/oldWALs 2024-02-27 02:55:52,974 INFO [RS:0;jenkins-hbase4:40779] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40779%2C1709002483314.meta:.meta(num 1709002485019) 2024-02-27 02:55:52,980 DEBUG [RS:0;jenkins-hbase4:40779] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/oldWALs 2024-02-27 02:55:52,981 INFO [RS:0;jenkins-hbase4:40779] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40779%2C1709002483314:(num 1709002484864) 2024-02-27 02:55:52,981 DEBUG [RS:0;jenkins-hbase4:40779] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 02:55:52,981 INFO [RS:0;jenkins-hbase4:40779] regionserver.LeaseManager(133): Closed leases 2024-02-27 02:55:52,981 INFO [RS:0;jenkins-hbase4:40779] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-02-27 02:55:52,981 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-27 02:55:52,982 INFO [RS:0;jenkins-hbase4:40779] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40779 2024-02-27 02:55:52,984 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40779,1709002483314 2024-02-27 02:55:52,984 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 02:55:52,986 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40779,1709002483314] 2024-02-27 02:55:52,986 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40779,1709002483314; numProcessing=2 2024-02-27 02:55:52,987 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40779,1709002483314 already deleted, retry=false 2024-02-27 02:55:52,987 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,40779,1709002483314 expired; onlineServers=0 2024-02-27 02:55:52,987 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,42961,1709002482057' ***** 2024-02-27 02:55:52,987 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-02-27 02:55:52,988 DEBUG [M:0;jenkins-hbase4:42961] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bb355bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-27 02:55:52,988 INFO [M:0;jenkins-hbase4:42961] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,42961,1709002482057 2024-02-27 02:55:52,988 INFO [M:0;jenkins-hbase4:42961] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,42961,1709002482057; all regions closed. 2024-02-27 02:55:52,988 DEBUG [M:0;jenkins-hbase4:42961] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 02:55:52,989 DEBUG [M:0;jenkins-hbase4:42961] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-02-27 02:55:52,989 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-02-27 02:55:52,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709002484494] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709002484494,5,FailOnTimeoutGroup] 2024-02-27 02:55:52,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709002484490] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709002484490,5,FailOnTimeoutGroup] 2024-02-27 02:55:52,989 DEBUG [M:0;jenkins-hbase4:42961] cleaner.HFileCleaner(317): Stopping file delete threads 2024-02-27 02:55:52,989 INFO [M:0;jenkins-hbase4:42961] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-02-27 02:55:52,989 INFO [M:0;jenkins-hbase4:42961] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-02-27 02:55:52,989 INFO [M:0;jenkins-hbase4:42961] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-02-27 02:55:52,989 DEBUG [M:0;jenkins-hbase4:42961] master.HMaster(1517): Stopping service threads 2024-02-27 02:55:52,990 INFO [M:0;jenkins-hbase4:42961] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-02-27 02:55:52,990 ERROR [M:0;jenkins-hbase4:42961] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] 2024-02-27 02:55:52,990 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-02-27 02:55:52,990 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 02:55:52,990 INFO [M:0;jenkins-hbase4:42961] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-02-27 02:55:52,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-27 02:55:52,990 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-02-27 02:55:52,991 DEBUG [M:0;jenkins-hbase4:42961] zookeeper.ZKUtil(399): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-02-27 02:55:52,991 WARN [M:0;jenkins-hbase4:42961] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-02-27 02:55:52,991 INFO [M:0;jenkins-hbase4:42961] assignment.AssignmentManager(315): Stopping assignment manager 2024-02-27 02:55:52,991 INFO [M:0;jenkins-hbase4:42961] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-02-27 02:55:52,992 DEBUG [M:0;jenkins-hbase4:42961] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-02-27 02:55:52,992 INFO [M:0;jenkins-hbase4:42961] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 02:55:52,992 DEBUG [M:0;jenkins-hbase4:42961] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 02:55:52,992 DEBUG [M:0;jenkins-hbase4:42961] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-02-27 02:55:52,992 DEBUG [M:0;jenkins-hbase4:42961] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 02:55:52,992 INFO [M:0;jenkins-hbase4:42961] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.07 KB heapSize=184.85 KB 2024-02-27 02:55:53,007 INFO [M:0;jenkins-hbase4:42961] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.07 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6a57e9feb49c4e6d92e5d4789a97280f 2024-02-27 02:55:53,013 INFO [M:0;jenkins-hbase4:42961] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a57e9feb49c4e6d92e5d4789a97280f 2024-02-27 02:55:53,015 DEBUG [M:0;jenkins-hbase4:42961] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6a57e9feb49c4e6d92e5d4789a97280f as hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6a57e9feb49c4e6d92e5d4789a97280f 2024-02-27 02:55:53,021 INFO [M:0;jenkins-hbase4:42961] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a57e9feb49c4e6d92e5d4789a97280f 2024-02-27 02:55:53,021 INFO [M:0;jenkins-hbase4:42961] regionserver.HStore(1080): Added hdfs://localhost:35999/user/jenkins/test-data/6e38790e-354d-813d-c003-da7b516d94cb/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6a57e9feb49c4e6d92e5d4789a97280f, entries=45, sequenceid=376, filesize=12.0 K 2024-02-27 02:55:53,022 INFO [M:0;jenkins-hbase4:42961] regionserver.HRegion(2948): Finished flush of dataSize ~153.07 KB/156745, heapSize ~184.84 KB/189272, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=376, compaction requested=false 2024-02-27 02:55:53,023 INFO [M:0;jenkins-hbase4:42961] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 02:55:53,023 DEBUG [M:0;jenkins-hbase4:42961] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-27 02:55:53,028 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-27 02:55:53,028 INFO [M:0;jenkins-hbase4:42961] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-02-27 02:55:53,028 INFO [M:0;jenkins-hbase4:42961] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42961 2024-02-27 02:55:53,030 DEBUG [M:0;jenkins-hbase4:42961] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42961,1709002482057 already deleted, retry=false 2024-02-27 02:55:53,086 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 02:55:53,086 INFO [RS:0;jenkins-hbase4:40779] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,40779,1709002483314; zookeeper connection closed. 2024-02-27 02:55:53,086 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): regionserver:40779-0x1000ddd257b0001, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 02:55:53,087 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b8de150] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b8de150 2024-02-27 02:55:53,087 INFO [Listener at localhost/35297] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-02-27 02:55:53,132 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 02:55:53,132 INFO [M:0;jenkins-hbase4:42961] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,42961,1709002482057; zookeeper connection closed. 2024-02-27 02:55:53,132 DEBUG [Listener at localhost/35297-EventThread] zookeeper.ZKWatcher(600): master:42961-0x1000ddd257b0000, quorum=127.0.0.1:63173, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 02:55:53,134 WARN [Listener at localhost/35297] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-02-27 02:55:53,136 INFO [Listener at localhost/35297] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-27 02:55:53,241 WARN [BP-323642637-172.31.14.131-1709002478816 heartbeating to localhost/127.0.0.1:35999] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-02-27 02:55:53,241 WARN [BP-323642637-172.31.14.131-1709002478816 heartbeating to localhost/127.0.0.1:35999] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-323642637-172.31.14.131-1709002478816 (Datanode Uuid 5e18fb73-57d7-48a9-97e1-fb8da27a587a) service to localhost/127.0.0.1:35999 2024-02-27 02:55:53,243 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/cluster_e2bc6166-dc27-5c3d-9875-4bd36d5db790/dfs/data/data3/current/BP-323642637-172.31.14.131-1709002478816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-27 02:55:53,243 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/cluster_e2bc6166-dc27-5c3d-9875-4bd36d5db790/dfs/data/data4/current/BP-323642637-172.31.14.131-1709002478816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-27 02:55:53,244 WARN [Listener at localhost/35297] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-02-27 02:55:53,246 INFO [Listener at localhost/35297] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-27 02:55:53,350 WARN [BP-323642637-172.31.14.131-1709002478816 heartbeating to localhost/127.0.0.1:35999] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-02-27 02:55:53,350 WARN [BP-323642637-172.31.14.131-1709002478816 heartbeating to localhost/127.0.0.1:35999] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-323642637-172.31.14.131-1709002478816 (Datanode Uuid ff83790c-0884-4430-bbc1-8b4c54170aaf) service to localhost/127.0.0.1:35999 2024-02-27 02:55:53,351 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/cluster_e2bc6166-dc27-5c3d-9875-4bd36d5db790/dfs/data/data1/current/BP-323642637-172.31.14.131-1709002478816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-27 02:55:53,351 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b179efd5-0dfd-d7e9-f7a0-3a866eccfde2/cluster_e2bc6166-dc27-5c3d-9875-4bd36d5db790/dfs/data/data2/current/BP-323642637-172.31.14.131-1709002478816] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-27 02:55:53,385 INFO [Listener at localhost/35297] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-27 02:55:53,500 INFO [Listener at localhost/35297] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-02-27 02:55:53,538 INFO [Listener at localhost/35297] hbase.HBaseTestingUtility(1293): Minicluster is down