2024-03-07 12:14:25,968 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-03-07 12:14:26,169 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e 2024-03-07 12:14:26,181 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-03-07 12:14:26,182 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/cluster_c91cfe98-0fce-3cda-638f-d6df315f0224, deleteOnExit=true 2024-03-07 12:14:26,182 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-03-07 12:14:26,182 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/test.cache.data in system properties and HBase conf 2024-03-07 12:14:26,183 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/hadoop.tmp.dir in system properties and HBase conf 2024-03-07 12:14:26,183 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/hadoop.log.dir in system properties and HBase conf 2024-03-07 12:14:26,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/mapreduce.cluster.local.dir in system properties and HBase conf 2024-03-07 12:14:26,184 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-03-07 12:14:26,184 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-03-07 12:14:26,293 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-03-07 12:14:26,652 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-03-07 12:14:26,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-03-07 12:14:26,656 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-03-07 12:14:26,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-03-07 12:14:26,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-07 12:14:26,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-03-07 12:14:26,657 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-03-07 12:14:26,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-07 12:14:26,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-07 12:14:26,658 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-03-07 12:14:26,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/nfs.dump.dir in system properties and HBase conf 2024-03-07 12:14:26,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/java.io.tmpdir in system properties and HBase conf 2024-03-07 12:14:26,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-07 12:14:26,659 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-03-07 12:14:26,660 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-03-07 12:14:27,110 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-07 12:14:27,114 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-07 12:14:27,537 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-03-07 12:14:27,693 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-03-07 12:14:27,708 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-07 12:14:27,740 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-03-07 12:14:27,768 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/java.io.tmpdir/Jetty_localhost_36015_hdfs____.jgoshx/webapp 2024-03-07 12:14:27,874 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36015 2024-03-07 12:14:27,881 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-07 12:14:27,882 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-07 12:14:28,437 WARN [Listener at localhost/39713] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-07 12:14:28,504 WARN [Listener at localhost/39713] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-07 12:14:28,522 WARN [Listener at localhost/39713] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-07 12:14:28,528 INFO [Listener at localhost/39713] log.Slf4jLog(67): jetty-6.1.26 2024-03-07 12:14:28,533 INFO [Listener at localhost/39713] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/java.io.tmpdir/Jetty_localhost_35133_datanode____4v4snq/webapp 2024-03-07 12:14:28,617 INFO [Listener at localhost/39713] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35133 2024-03-07 12:14:28,916 WARN [Listener at localhost/42819] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-07 12:14:28,928 WARN [Listener at localhost/42819] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-07 12:14:28,932 WARN [Listener at localhost/42819] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-07 12:14:28,935 INFO [Listener at localhost/42819] log.Slf4jLog(67): jetty-6.1.26 2024-03-07 12:14:28,943 INFO [Listener at localhost/42819] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/java.io.tmpdir/Jetty_localhost_42055_datanode____17tda1/webapp 2024-03-07 12:14:29,032 INFO [Listener at localhost/42819] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42055 2024-03-07 12:14:29,043 WARN [Listener at localhost/44719] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-07 12:14:29,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3116c3e1b3e24d0b: Processing first storage report for DS-b31b2ed5-53af-4024-88ff-e9f37675505b from datanode d484c01d-b772-4695-962f-4d23983cde7e 2024-03-07 12:14:29,894 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3116c3e1b3e24d0b: from storage DS-b31b2ed5-53af-4024-88ff-e9f37675505b node DatanodeRegistration(127.0.0.1:46281, datanodeUuid=d484c01d-b772-4695-962f-4d23983cde7e, infoPort=41991, infoSecurePort=0, ipcPort=44719, storageInfo=lv=-57;cid=testClusterID;nsid=1791203736;c=1709813667177), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-03-07 12:14:29,895 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3116c3e1b3e24d0b: Processing first storage report for DS-73640210-f7a9-4586-9fbb-dacff1c6a479 from datanode d484c01d-b772-4695-962f-4d23983cde7e 2024-03-07 12:14:29,895 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3116c3e1b3e24d0b: from storage DS-73640210-f7a9-4586-9fbb-dacff1c6a479 node DatanodeRegistration(127.0.0.1:46281, datanodeUuid=d484c01d-b772-4695-962f-4d23983cde7e, infoPort=41991, infoSecurePort=0, ipcPort=44719, storageInfo=lv=-57;cid=testClusterID;nsid=1791203736;c=1709813667177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-07 12:14:30,083 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc93de6cf90353353: Processing first storage report for DS-95703940-35da-40e6-9d19-45e4ea9f38f4 from datanode 5e7d11c3-2a58-4900-af66-8052aaa38c0e 2024-03-07 12:14:30,084 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc93de6cf90353353: from storage DS-95703940-35da-40e6-9d19-45e4ea9f38f4 node DatanodeRegistration(127.0.0.1:39387, datanodeUuid=5e7d11c3-2a58-4900-af66-8052aaa38c0e, infoPort=41847, infoSecurePort=0, ipcPort=42819, storageInfo=lv=-57;cid=testClusterID;nsid=1791203736;c=1709813667177), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-07 12:14:30,084 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc93de6cf90353353: Processing first storage report for DS-56e6ec02-3032-453a-9598-9307c4bfa762 from datanode 5e7d11c3-2a58-4900-af66-8052aaa38c0e 2024-03-07 12:14:30,084 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc93de6cf90353353: from storage DS-56e6ec02-3032-453a-9598-9307c4bfa762 node DatanodeRegistration(127.0.0.1:39387, datanodeUuid=5e7d11c3-2a58-4900-af66-8052aaa38c0e, infoPort=41847, infoSecurePort=0, ipcPort=42819, storageInfo=lv=-57;cid=testClusterID;nsid=1791203736;c=1709813667177), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-07 12:14:30,098 DEBUG [Listener at localhost/44719] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e 2024-03-07 12:14:30,202 INFO [Listener at localhost/44719] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/cluster_c91cfe98-0fce-3cda-638f-d6df315f0224/zookeeper_0, clientPort=54158, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/cluster_c91cfe98-0fce-3cda-638f-d6df315f0224/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/cluster_c91cfe98-0fce-3cda-638f-d6df315f0224/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-03-07 12:14:30,222 INFO [Listener at localhost/44719] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54158 2024-03-07 12:14:30,229 INFO [Listener at localhost/44719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:30,231 INFO [Listener at localhost/44719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:30,892 INFO [Listener at localhost/44719] util.FSUtils(471): Created version file at hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28 with version=8 2024-03-07 12:14:30,893 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/hbase-staging 2024-03-07 12:14:31,201 INFO [Listener at localhost/44719] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-03-07 12:14:31,615 INFO [Listener at localhost/44719] client.ConnectionUtils(126): master/jenkins-hbase16:0 server-side Connection retries=45 2024-03-07 12:14:31,644 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:31,644 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:31,645 INFO [Listener at localhost/44719] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-07 12:14:31,645 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:31,645 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-07 12:14:31,788 INFO [Listener at localhost/44719] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-03-07 12:14:31,855 DEBUG [Listener at localhost/44719] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-03-07 12:14:31,945 INFO [Listener at localhost/44719] ipc.NettyRpcServer(120): Bind to /188.40.62.62:37039 2024-03-07 12:14:31,954 INFO [Listener at localhost/44719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:31,957 INFO [Listener at localhost/44719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:31,978 INFO [Listener at localhost/44719] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37039 connecting to ZooKeeper ensemble=127.0.0.1:54158 2024-03-07 12:14:32,100 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:370390x0, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-07 12:14:32,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37039-0x1003cecce640000 connected 2024-03-07 12:14:32,178 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-07 12:14:32,179 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-07 12:14:32,182 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-07 12:14:32,190 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37039 2024-03-07 12:14:32,191 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37039 2024-03-07 12:14:32,191 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37039 2024-03-07 12:14:32,192 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37039 2024-03-07 12:14:32,192 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37039 2024-03-07 12:14:32,197 INFO [Listener at localhost/44719] master.HMaster(445): hbase.rootdir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28, hbase.cluster.distributed=false 2024-03-07 12:14:32,260 INFO [Listener at localhost/44719] client.ConnectionUtils(126): regionserver/jenkins-hbase16:0 server-side Connection retries=45 2024-03-07 12:14:32,260 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:32,260 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:32,260 INFO [Listener at localhost/44719] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-07 12:14:32,260 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:32,260 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-07 12:14:32,265 INFO [Listener at localhost/44719] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-07 12:14:32,268 INFO [Listener at localhost/44719] ipc.NettyRpcServer(120): Bind to /188.40.62.62:34997 2024-03-07 12:14:32,270 INFO [Listener at localhost/44719] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-07 12:14:32,276 DEBUG [Listener at localhost/44719] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-07 12:14:32,277 INFO [Listener at localhost/44719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:32,279 INFO [Listener at localhost/44719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:32,281 INFO [Listener at localhost/44719] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34997 connecting to ZooKeeper ensemble=127.0.0.1:54158 2024-03-07 12:14:32,291 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:349970x0, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-07 12:14:32,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34997-0x1003cecce640001 connected 2024-03-07 12:14:32,293 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-07 12:14:32,294 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-07 12:14:32,295 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-07 12:14:32,296 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34997 2024-03-07 12:14:32,297 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34997 2024-03-07 12:14:32,298 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34997 2024-03-07 12:14:32,298 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34997 2024-03-07 12:14:32,299 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34997 2024-03-07 12:14:32,309 INFO [Listener at localhost/44719] client.ConnectionUtils(126): regionserver/jenkins-hbase16:0 server-side Connection retries=45 2024-03-07 12:14:32,310 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:32,310 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:32,310 INFO [Listener at localhost/44719] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-07 12:14:32,310 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-07 12:14:32,310 INFO [Listener at localhost/44719] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-07 12:14:32,311 INFO [Listener at localhost/44719] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-07 12:14:32,312 INFO [Listener at localhost/44719] ipc.NettyRpcServer(120): Bind to /188.40.62.62:41591 2024-03-07 12:14:32,313 INFO [Listener at localhost/44719] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-07 12:14:32,315 DEBUG [Listener at localhost/44719] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-07 12:14:32,316 INFO [Listener at localhost/44719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:32,317 INFO [Listener at localhost/44719] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:32,320 INFO [Listener at localhost/44719] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41591 connecting to ZooKeeper ensemble=127.0.0.1:54158 2024-03-07 12:14:32,333 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:415910x0, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-07 12:14:32,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41591-0x1003cecce640002 connected 2024-03-07 12:14:32,335 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-07 12:14:32,336 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-07 12:14:32,337 DEBUG [Listener at localhost/44719] zookeeper.ZKUtil(165): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-07 12:14:32,337 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41591 2024-03-07 12:14:32,338 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41591 2024-03-07 12:14:32,339 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41591 2024-03-07 12:14:32,343 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41591 2024-03-07 12:14:32,343 DEBUG [Listener at localhost/44719] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41591 2024-03-07 12:14:32,345 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:14:32,359 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-07 12:14:32,361 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:14:32,388 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-07 12:14:32,388 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-07 12:14:32,388 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-07 12:14:32,390 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:14:32,390 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-07 12:14:32,392 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase16.apache.org,37039,1709813671023 from backup master directory 2024-03-07 12:14:32,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-07 12:14:32,399 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:14:32,400 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-07 12:14:32,400 WARN [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-07 12:14:32,400 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:14:32,403 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-03-07 12:14:32,404 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-03-07 12:14:32,495 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/hbase.id with ID: b3f976ab-530c-4a25-9d22-07bb4c07c48b 2024-03-07 12:14:32,542 INFO [master/jenkins-hbase16:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-07 12:14:32,566 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:14:32,614 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x661d37e7 to 127.0.0.1:54158 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-07 12:14:32,656 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ae8aaac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-07 12:14:32,680 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-07 12:14:32,682 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-03-07 12:14:32,699 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-03-07 12:14:32,699 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-03-07 12:14:32,701 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-07 12:14:32,705 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-07 12:14:32,706 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-07 12:14:32,738 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store-tmp 2024-03-07 12:14:32,770 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:32,770 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-07 12:14:32,771 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-07 12:14:32,771 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-07 12:14:32,771 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-07 12:14:32,771 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-07 12:14:32,771 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-07 12:14:32,771 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-07 12:14:32,773 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/WALs/jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:14:32,794 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C37039%2C1709813671023, suffix=, logDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/WALs/jenkins-hbase16.apache.org,37039,1709813671023, archiveDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/oldWALs, maxLogs=10 2024-03-07 12:14:32,850 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39387,DS-95703940-35da-40e6-9d19-45e4ea9f38f4,DISK] 2024-03-07 12:14:32,850 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46281,DS-b31b2ed5-53af-4024-88ff-e9f37675505b,DISK] 2024-03-07 12:14:32,861 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-03-07 12:14:32,924 INFO [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/WALs/jenkins-hbase16.apache.org,37039,1709813671023/jenkins-hbase16.apache.org%2C37039%2C1709813671023.1709813672802 2024-03-07 12:14:32,924 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46281,DS-b31b2ed5-53af-4024-88ff-e9f37675505b,DISK], DatanodeInfoWithStorage[127.0.0.1:39387,DS-95703940-35da-40e6-9d19-45e4ea9f38f4,DISK]] 2024-03-07 12:14:32,925 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-03-07 12:14:32,925 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:32,928 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-03-07 12:14:32,930 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-03-07 12:14:32,983 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-03-07 12:14:32,990 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-03-07 12:14:33,012 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-03-07 12:14:33,024 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:33,029 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-07 12:14:33,032 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-07 12:14:33,048 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-03-07 12:14:33,056 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:33,058 INFO [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60039223, jitterRate=-0.10534586012363434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-07 12:14:33,058 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-07 12:14:33,059 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-03-07 12:14:33,078 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-03-07 12:14:33,078 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-03-07 12:14:33,080 INFO [master/jenkins-hbase16:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-03-07 12:14:33,082 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-03-07 12:14:33,114 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 31 msec 2024-03-07 12:14:33,114 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-03-07 12:14:33,139 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-03-07 12:14:33,145 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-03-07 12:14:33,171 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-03-07 12:14:33,174 INFO [master/jenkins-hbase16:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-03-07 12:14:33,176 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-03-07 12:14:33,181 INFO [master/jenkins-hbase16:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-03-07 12:14:33,186 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-03-07 12:14:33,222 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:14:33,223 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-03-07 12:14:33,224 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-03-07 12:14:33,240 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-03-07 12:14:33,255 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-07 12:14:33,255 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-07 12:14:33,255 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-07 12:14:33,255 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:14:33,256 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase16.apache.org,37039,1709813671023, sessionid=0x1003cecce640000, setting cluster-up flag (Was=false) 2024-03-07 12:14:33,291 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:14:33,316 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-03-07 12:14:33,318 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:14:33,341 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:14:33,366 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-03-07 12:14:33,368 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:14:33,371 WARN [master/jenkins-hbase16:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.hbase-snapshot/.tmp 2024-03-07 12:14:33,410 INFO [master/jenkins-hbase16:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-03-07 12:14:33,447 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(954): ClusterId : b3f976ab-530c-4a25-9d22-07bb4c07c48b 2024-03-07 12:14:33,447 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(954): ClusterId : b3f976ab-530c-4a25-9d22-07bb4c07c48b 2024-03-07 12:14:33,452 DEBUG [RS:1;jenkins-hbase16:41591] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-07 12:14:33,452 DEBUG [RS:0;jenkins-hbase16:34997] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-07 12:14:33,465 DEBUG [RS:0;jenkins-hbase16:34997] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-07 12:14:33,465 DEBUG [RS:1;jenkins-hbase16:41591] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-07 12:14:33,465 DEBUG [RS:0;jenkins-hbase16:34997] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-07 12:14:33,466 DEBUG [RS:1;jenkins-hbase16:41591] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-07 12:14:33,476 DEBUG [RS:0;jenkins-hbase16:34997] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-07 12:14:33,476 DEBUG [RS:1;jenkins-hbase16:41591] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-07 12:14:33,478 DEBUG [RS:0;jenkins-hbase16:34997] zookeeper.ReadOnlyZKClient(139): Connect 0x61f80d33 to 127.0.0.1:54158 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-07 12:14:33,479 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-03-07 12:14:33,479 DEBUG [RS:1;jenkins-hbase16:41591] zookeeper.ReadOnlyZKClient(139): Connect 0x7ab16865 to 127.0.0.1:54158 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-07 12:14:33,489 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2024-03-07 12:14:33,490 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2024-03-07 12:14:33,490 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2024-03-07 12:14:33,490 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=5, maxPoolSize=5 2024-03-07 12:14:33,490 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase16:0, corePoolSize=10, maxPoolSize=10 2024-03-07 12:14:33,490 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,490 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2024-03-07 12:14:33,490 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,492 DEBUG [RS:1;jenkins-hbase16:41591] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74769943, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-07 12:14:33,492 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1709813703492 2024-03-07 12:14:33,492 DEBUG [RS:0;jenkins-hbase16:34997] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f3fff7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-07 12:14:33,493 DEBUG [RS:1;jenkins-hbase16:41591] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70490315, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2024-03-07 12:14:33,493 DEBUG [RS:0;jenkins-hbase16:34997] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b006643, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2024-03-07 12:14:33,496 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-03-07 12:14:33,499 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-03-07 12:14:33,500 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-03-07 12:14:33,507 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-03-07 12:14:33,509 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-07 12:14:33,516 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-03-07 12:14:33,516 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-03-07 12:14:33,517 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-03-07 12:14:33,517 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-03-07 12:14:33,517 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase16:34997 2024-03-07 12:14:33,519 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase16:41591 2024-03-07 12:14:33,521 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,523 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-03-07 12:14:33,523 INFO [RS:0;jenkins-hbase16:34997] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-07 12:14:33,523 INFO [RS:1;jenkins-hbase16:41591] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-07 12:14:33,524 INFO [RS:1;jenkins-hbase16:41591] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-07 12:14:33,524 INFO [RS:0;jenkins-hbase16:34997] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-07 12:14:33,524 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1025): About to register with Master. 2024-03-07 12:14:33,524 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-03-07 12:14:33,524 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1025): About to register with Master. 2024-03-07 12:14:33,525 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-03-07 12:14:33,527 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase16.apache.org,37039,1709813671023 with isa=jenkins-hbase16.apache.org/188.40.62.62:34997, startcode=1709813672259 2024-03-07 12:14:33,527 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase16.apache.org,37039,1709813671023 with isa=jenkins-hbase16.apache.org/188.40.62.62:41591, startcode=1709813672309 2024-03-07 12:14:33,529 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-03-07 12:14:33,529 INFO [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-03-07 12:14:33,531 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1709813673531,5,FailOnTimeoutGroup] 2024-03-07 12:14:33,531 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1709813673531,5,FailOnTimeoutGroup] 2024-03-07 12:14:33,532 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,532 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-03-07 12:14:33,534 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,534 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,551 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-07 12:14:33,553 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-07 12:14:33,553 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28 2024-03-07 12:14:33,554 DEBUG [RS:1;jenkins-hbase16:41591] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-07 12:14:33,554 DEBUG [RS:0;jenkins-hbase16:34997] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-07 12:14:33,581 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:33,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-07 12:14:33,591 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/info 2024-03-07 12:14:33,591 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-07 12:14:33,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:33,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-07 12:14:33,597 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/rep_barrier 2024-03-07 12:14:33,598 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-07 12:14:33,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:33,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-07 12:14:33,602 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/table 2024-03-07 12:14:33,603 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-07 12:14:33,604 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:33,607 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740 2024-03-07 12:14:33,609 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740 2024-03-07 12:14:33,614 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-07 12:14:33,617 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-07 12:14:33,622 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:47573, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-03-07 12:14:33,622 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:53913, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-03-07 12:14:33,623 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:33,625 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64987871, jitterRate=-0.03160525858402252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-07 12:14:33,625 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-07 12:14:33,625 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-07 12:14:33,625 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-07 12:14:33,625 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-07 12:14:33,625 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-07 12:14:33,625 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-07 12:14:33,626 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-07 12:14:33,627 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-07 12:14:33,632 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-03-07 12:14:33,632 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-03-07 12:14:33,636 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37039] master.ServerManager(388): Registering regionserver=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:33,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-03-07 12:14:33,646 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37039] master.ServerManager(388): Registering regionserver=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:33,652 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28 2024-03-07 12:14:33,652 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:39713 2024-03-07 12:14:33,652 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28 2024-03-07 12:14:33,652 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:39713 2024-03-07 12:14:33,652 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-07 12:14:33,652 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-07 12:14:33,660 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-03-07 12:14:33,663 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-03-07 12:14:33,700 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-07 12:14:33,701 DEBUG [RS:1;jenkins-hbase16:41591] zookeeper.ZKUtil(163): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:33,701 DEBUG [RS:0;jenkins-hbase16:34997] zookeeper.ZKUtil(163): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:33,701 WARN [RS:1;jenkins-hbase16:41591] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-07 12:14:33,701 WARN [RS:0;jenkins-hbase16:34997] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-07 12:14:33,702 INFO [RS:1;jenkins-hbase16:41591] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-07 12:14:33,702 INFO [RS:0;jenkins-hbase16:34997] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-07 12:14:33,702 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1950): logDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/WALs/jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:33,702 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1950): logDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/WALs/jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:33,705 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,34997,1709813672259] 2024-03-07 12:14:33,705 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase16.apache.org,41591,1709813672309] 2024-03-07 12:14:33,714 DEBUG [RS:0;jenkins-hbase16:34997] zookeeper.ZKUtil(163): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:33,714 DEBUG [RS:1;jenkins-hbase16:41591] zookeeper.ZKUtil(163): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:33,715 DEBUG [RS:0;jenkins-hbase16:34997] zookeeper.ZKUtil(163): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:33,716 DEBUG [RS:1;jenkins-hbase16:41591] zookeeper.ZKUtil(163): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:33,725 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-07 12:14:33,725 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-07 12:14:33,734 INFO [RS:0;jenkins-hbase16:34997] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-07 12:14:33,734 INFO [RS:1;jenkins-hbase16:41591] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-07 12:14:33,753 INFO [RS:0;jenkins-hbase16:34997] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-07 12:14:33,753 INFO [RS:1;jenkins-hbase16:41591] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-07 12:14:33,757 INFO [RS:0;jenkins-hbase16:34997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-07 12:14:33,757 INFO [RS:1;jenkins-hbase16:41591] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-07 12:14:33,757 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,757 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,759 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-07 12:14:33,759 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-07 12:14:33,766 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,766 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,766 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,766 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,767 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2024-03-07 12:14:33,768 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase16:0, corePoolSize=2, maxPoolSize=2 2024-03-07 12:14:33,768 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,768 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,768 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,768 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,768 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,768 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,768 DEBUG [RS:0;jenkins-hbase16:34997] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,768 DEBUG [RS:1;jenkins-hbase16:41591] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase16:0, corePoolSize=1, maxPoolSize=1 2024-03-07 12:14:33,770 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,770 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,770 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,770 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,771 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,771 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,771 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,771 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,785 INFO [RS:0;jenkins-hbase16:34997] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-07 12:14:33,785 INFO [RS:1;jenkins-hbase16:41591] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-07 12:14:33,789 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,34997,1709813672259-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,789 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,41591,1709813672309-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,806 INFO [RS:0;jenkins-hbase16:34997] regionserver.Replication(203): jenkins-hbase16.apache.org,34997,1709813672259 started 2024-03-07 12:14:33,806 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1640): Serving as jenkins-hbase16.apache.org,34997,1709813672259, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:34997, sessionid=0x1003cecce640001 2024-03-07 12:14:33,806 DEBUG [RS:0;jenkins-hbase16:34997] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-07 12:14:33,806 DEBUG [RS:0;jenkins-hbase16:34997] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:33,806 DEBUG [RS:0;jenkins-hbase16:34997] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,34997,1709813672259' 2024-03-07 12:14:33,807 DEBUG [RS:0;jenkins-hbase16:34997] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-07 12:14:33,807 DEBUG [RS:0;jenkins-hbase16:34997] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-07 12:14:33,808 DEBUG [RS:0;jenkins-hbase16:34997] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-07 12:14:33,808 INFO [RS:1;jenkins-hbase16:41591] regionserver.Replication(203): jenkins-hbase16.apache.org,41591,1709813672309 started 2024-03-07 12:14:33,808 DEBUG [RS:0;jenkins-hbase16:34997] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-07 12:14:33,808 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1640): Serving as jenkins-hbase16.apache.org,41591,1709813672309, RpcServer on jenkins-hbase16.apache.org/188.40.62.62:41591, sessionid=0x1003cecce640002 2024-03-07 12:14:33,808 DEBUG [RS:0;jenkins-hbase16:34997] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:33,808 DEBUG [RS:0;jenkins-hbase16:34997] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,34997,1709813672259' 2024-03-07 12:14:33,809 DEBUG [RS:0;jenkins-hbase16:34997] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-07 12:14:33,808 DEBUG [RS:1;jenkins-hbase16:41591] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-07 12:14:33,809 DEBUG [RS:1;jenkins-hbase16:41591] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:33,809 DEBUG [RS:1;jenkins-hbase16:41591] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,41591,1709813672309' 2024-03-07 12:14:33,810 DEBUG [RS:1;jenkins-hbase16:41591] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-07 12:14:33,810 DEBUG [RS:0;jenkins-hbase16:34997] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-07 12:14:33,810 DEBUG [RS:1;jenkins-hbase16:41591] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-07 12:14:33,811 DEBUG [RS:0;jenkins-hbase16:34997] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-07 12:14:33,811 INFO [RS:0;jenkins-hbase16:34997] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-07 12:14:33,811 DEBUG [RS:1;jenkins-hbase16:41591] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-07 12:14:33,811 DEBUG [RS:1;jenkins-hbase16:41591] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-07 12:14:33,811 DEBUG [RS:1;jenkins-hbase16:41591] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:33,812 DEBUG [RS:1;jenkins-hbase16:41591] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase16.apache.org,41591,1709813672309' 2024-03-07 12:14:33,812 DEBUG [RS:1;jenkins-hbase16:41591] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-07 12:14:33,812 DEBUG [RS:1;jenkins-hbase16:41591] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-07 12:14:33,814 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,814 DEBUG [jenkins-hbase16:37039] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-03-07 12:14:33,818 DEBUG [jenkins-hbase16:37039] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2024-03-07 12:14:33,821 DEBUG [RS:0;jenkins-hbase16:34997] zookeeper.ZKUtil(399): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-07 12:14:33,821 DEBUG [RS:1;jenkins-hbase16:41591] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-07 12:14:33,821 INFO [RS:0;jenkins-hbase16:34997] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-07 12:14:33,821 INFO [RS:1;jenkins-hbase16:41591] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-07 12:14:33,822 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,822 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,823 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,823 DEBUG [RS:1;jenkins-hbase16:41591] zookeeper.ZKUtil(399): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-07 12:14:33,823 INFO [RS:1;jenkins-hbase16:41591] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-07 12:14:33,823 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,823 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:33,825 DEBUG [jenkins-hbase16:37039] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-07 12:14:33,825 DEBUG [jenkins-hbase16:37039] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-07 12:14:33,825 DEBUG [jenkins-hbase16:37039] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-07 12:14:33,828 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,41591,1709813672309, state=OPENING 2024-03-07 12:14:33,855 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-03-07 12:14:33,866 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:14:33,867 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-07 12:14:33,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,41591,1709813672309}] 2024-03-07 12:14:33,934 INFO [RS:0;jenkins-hbase16:34997] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C34997%2C1709813672259, suffix=, logDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/WALs/jenkins-hbase16.apache.org,34997,1709813672259, archiveDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/oldWALs, maxLogs=32 2024-03-07 12:14:33,934 INFO [RS:1;jenkins-hbase16:41591] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C41591%2C1709813672309, suffix=, logDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/WALs/jenkins-hbase16.apache.org,41591,1709813672309, archiveDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/oldWALs, maxLogs=32 2024-03-07 12:14:33,953 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39387,DS-95703940-35da-40e6-9d19-45e4ea9f38f4,DISK] 2024-03-07 12:14:33,953 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46281,DS-b31b2ed5-53af-4024-88ff-e9f37675505b,DISK] 2024-03-07 12:14:33,962 INFO [RS:0;jenkins-hbase16:34997] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/WALs/jenkins-hbase16.apache.org,34997,1709813672259/jenkins-hbase16.apache.org%2C34997%2C1709813672259.1709813673937 2024-03-07 12:14:33,963 DEBUG [RS:0;jenkins-hbase16:34997] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39387,DS-95703940-35da-40e6-9d19-45e4ea9f38f4,DISK], DatanodeInfoWithStorage[127.0.0.1:46281,DS-b31b2ed5-53af-4024-88ff-e9f37675505b,DISK]] 2024-03-07 12:14:33,987 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46281,DS-b31b2ed5-53af-4024-88ff-e9f37675505b,DISK] 2024-03-07 12:14:33,987 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39387,DS-95703940-35da-40e6-9d19-45e4ea9f38f4,DISK] 2024-03-07 12:14:33,993 INFO [RS:1;jenkins-hbase16:41591] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/WALs/jenkins-hbase16.apache.org,41591,1709813672309/jenkins-hbase16.apache.org%2C41591%2C1709813672309.1709813673938 2024-03-07 12:14:33,994 DEBUG [RS:1;jenkins-hbase16:41591] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46281,DS-b31b2ed5-53af-4024-88ff-e9f37675505b,DISK], DatanodeInfoWithStorage[127.0.0.1:39387,DS-95703940-35da-40e6-9d19-45e4ea9f38f4,DISK]] 2024-03-07 12:14:34,051 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:34,054 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-07 12:14:34,058 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:32926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-07 12:14:34,069 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-03-07 12:14:34,070 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-07 12:14:34,073 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase16.apache.org%2C41591%2C1709813672309.meta, suffix=.meta, logDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/WALs/jenkins-hbase16.apache.org,41591,1709813672309, archiveDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/oldWALs, maxLogs=32 2024-03-07 12:14:34,089 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39387,DS-95703940-35da-40e6-9d19-45e4ea9f38f4,DISK] 2024-03-07 12:14:34,089 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46281,DS-b31b2ed5-53af-4024-88ff-e9f37675505b,DISK] 2024-03-07 12:14:34,097 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/WALs/jenkins-hbase16.apache.org,41591,1709813672309/jenkins-hbase16.apache.org%2C41591%2C1709813672309.meta.1709813674074.meta 2024-03-07 12:14:34,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39387,DS-95703940-35da-40e6-9d19-45e4ea9f38f4,DISK], DatanodeInfoWithStorage[127.0.0.1:46281,DS-b31b2ed5-53af-4024-88ff-e9f37675505b,DISK]] 2024-03-07 12:14:34,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-03-07 12:14:34,101 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-03-07 12:14:34,120 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-03-07 12:14:34,124 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-03-07 12:14:34,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-03-07 12:14:34,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:34,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-03-07 12:14:34,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-03-07 12:14:34,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-07 12:14:34,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/info 2024-03-07 12:14:34,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/info 2024-03-07 12:14:34,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-07 12:14:34,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:34,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-07 12:14:34,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/rep_barrier 2024-03-07 12:14:34,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/rep_barrier 2024-03-07 12:14:34,140 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-07 12:14:34,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:34,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-07 12:14:34,143 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/table 2024-03-07 12:14:34,143 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/table 2024-03-07 12:14:34,144 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-07 12:14:34,145 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:34,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740 2024-03-07 12:14:34,150 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740 2024-03-07 12:14:34,154 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-07 12:14:34,158 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-07 12:14:34,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72912304, jitterRate=0.08647799491882324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-07 12:14:34,160 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-07 12:14:34,173 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1709813674045 2024-03-07 12:14:34,190 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-03-07 12:14:34,191 INFO [RS_OPEN_META-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-03-07 12:14:34,192 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase16.apache.org,41591,1709813672309, state=OPEN 2024-03-07 12:14:34,205 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-03-07 12:14:34,205 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-07 12:14:34,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-03-07 12:14:34,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase16.apache.org,41591,1709813672309 in 335 msec 2024-03-07 12:14:34,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-03-07 12:14:34,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 572 msec 2024-03-07 12:14:34,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 807 msec 2024-03-07 12:14:34,227 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1709813674226, completionTime=-1 2024-03-07 12:14:34,227 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-03-07 12:14:34,227 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-03-07 12:14:34,290 DEBUG [hconnection-0x5ac0640a-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-07 12:14:34,294 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:32934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-07 12:14:34,311 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-03-07 12:14:34,311 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1709813734311 2024-03-07 12:14:34,311 INFO [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1709813794311 2024-03-07 12:14:34,312 INFO [master/jenkins-hbase16:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 84 msec 2024-03-07 12:14:34,351 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,37039,1709813671023-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:34,351 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,37039,1709813671023-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:34,351 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,37039,1709813671023-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:34,353 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase16:37039, period=300000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:34,354 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:34,361 DEBUG [master/jenkins-hbase16:0.Chore.1] janitor.CatalogJanitor(175): 2024-03-07 12:14:34,368 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-03-07 12:14:34,369 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-07 12:14:34,378 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-03-07 12:14:34,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-03-07 12:14:34,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-07 12:14:34,408 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/hbase/namespace/e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,410 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/hbase/namespace/e526d9252721d81227d41279ca497aa0 empty. 2024-03-07 12:14:34,411 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/hbase/namespace/e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,411 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-03-07 12:14:34,448 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-03-07 12:14:34,450 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e526d9252721d81227d41279ca497aa0, NAME => 'hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp 2024-03-07 12:14:34,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:34,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e526d9252721d81227d41279ca497aa0, disabling compactions & flushes 2024-03-07 12:14:34,470 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:14:34,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:14:34,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. after waiting 0 ms 2024-03-07 12:14:34,470 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:14:34,470 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:14:34,471 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e526d9252721d81227d41279ca497aa0: 2024-03-07 12:14:34,476 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-03-07 12:14:34,491 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709813674479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813674479"}]},"ts":"1709813674479"} 2024-03-07 12:14:34,523 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-07 12:14:34,525 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-07 12:14:34,529 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813674525"}]},"ts":"1709813674525"} 2024-03-07 12:14:34,534 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-03-07 12:14:34,558 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2024-03-07 12:14:34,560 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-07 12:14:34,560 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-07 12:14:34,560 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-07 12:14:34,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e526d9252721d81227d41279ca497aa0, ASSIGN}] 2024-03-07 12:14:34,566 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e526d9252721d81227d41279ca497aa0, ASSIGN 2024-03-07 12:14:34,569 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e526d9252721d81227d41279ca497aa0, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,34997,1709813672259; forceNewPlan=false, retain=false 2024-03-07 12:14:34,721 INFO [jenkins-hbase16:37039] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-07 12:14:34,722 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e526d9252721d81227d41279ca497aa0, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:34,722 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709813674722"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813674722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813674722"}]},"ts":"1709813674722"} 2024-03-07 12:14:34,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e526d9252721d81227d41279ca497aa0, server=jenkins-hbase16.apache.org,34997,1709813672259}] 2024-03-07 12:14:34,885 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:34,886 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-07 12:14:34,889 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:44476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-07 12:14:34,903 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:14:34,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e526d9252721d81227d41279ca497aa0, NAME => 'hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0.', STARTKEY => '', ENDKEY => ''} 2024-03-07 12:14:34,905 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:34,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,909 INFO [StoreOpener-e526d9252721d81227d41279ca497aa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,913 DEBUG [StoreOpener-e526d9252721d81227d41279ca497aa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0/info 2024-03-07 12:14:34,913 DEBUG [StoreOpener-e526d9252721d81227d41279ca497aa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0/info 2024-03-07 12:14:34,914 INFO [StoreOpener-e526d9252721d81227d41279ca497aa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e526d9252721d81227d41279ca497aa0 columnFamilyName info 2024-03-07 12:14:34,915 INFO [StoreOpener-e526d9252721d81227d41279ca497aa0-1] regionserver.HStore(310): Store=e526d9252721d81227d41279ca497aa0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:34,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,919 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for e526d9252721d81227d41279ca497aa0 2024-03-07 12:14:34,927 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:34,928 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened e526d9252721d81227d41279ca497aa0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65418511, jitterRate=-0.025188222527503967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-07 12:14:34,928 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for e526d9252721d81227d41279ca497aa0: 2024-03-07 12:14:34,931 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0., pid=6, masterSystemTime=1709813674885 2024-03-07 12:14:34,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:14:34,939 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:14:34,941 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e526d9252721d81227d41279ca497aa0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:34,941 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709813674940"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1709813674940"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709813674940"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709813674940"}]},"ts":"1709813674940"} 2024-03-07 12:14:34,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-03-07 12:14:34,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e526d9252721d81227d41279ca497aa0, server=jenkins-hbase16.apache.org,34997,1709813672259 in 216 msec 2024-03-07 12:14:34,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-03-07 12:14:34,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e526d9252721d81227d41279ca497aa0, ASSIGN in 389 msec 2024-03-07 12:14:34,959 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-07 12:14:34,959 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813674959"}]},"ts":"1709813674959"} 2024-03-07 12:14:34,964 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-03-07 12:14:35,184 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-03-07 12:14:35,184 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-03-07 12:14:35,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 815 msec 2024-03-07 12:14:35,266 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-03-07 12:14:35,266 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:14:35,286 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-07 12:14:35,290 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:44492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-07 12:14:35,302 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-03-07 12:14:35,383 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-07 12:14:35,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 100 msec 2024-03-07 12:14:35,407 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-03-07 12:14:35,430 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-07 12:14:35,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 36 msec 2024-03-07 12:14:35,466 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-03-07 12:14:35,482 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-03-07 12:14:35,483 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 3.082sec 2024-03-07 12:14:35,486 INFO [master/jenkins-hbase16:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-03-07 12:14:35,486 INFO [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-07 12:14:35,488 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-03-07 12:14:35,489 INFO [master/jenkins-hbase16:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-03-07 12:14:35,492 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-03-07 12:14:35,493 INFO [master/jenkins-hbase16:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-03-07 12:14:35,495 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-07 12:14:35,500 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,501 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05 empty. 2024-03-07 12:14:35,501 INFO [master/jenkins-hbase16:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-03-07 12:14:35,502 INFO [master/jenkins-hbase16:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-03-07 12:14:35,504 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,504 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-03-07 12:14:35,505 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:35,505 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:35,507 INFO [master/jenkins-hbase16:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-03-07 12:14:35,507 INFO [master/jenkins-hbase16:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-03-07 12:14:35,508 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,37039,1709813671023-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-03-07 12:14:35,509 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,37039,1709813671023-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-03-07 12:14:35,521 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-03-07 12:14:35,521 INFO [master/jenkins-hbase16:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase16.apache.org,37039,1709813671023-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-07 12:14:35,531 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-03-07 12:14:35,533 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7af7cbf8b716e08a8d591b578a21be05, NAME => 'hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp 2024-03-07 12:14:35,558 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:35,559 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 7af7cbf8b716e08a8d591b578a21be05, disabling compactions & flushes 2024-03-07 12:14:35,559 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:14:35,559 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:14:35,559 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. after waiting 0 ms 2024-03-07 12:14:35,559 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:14:35,559 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:14:35,559 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 7af7cbf8b716e08a8d591b578a21be05: 2024-03-07 12:14:35,561 DEBUG [Listener at localhost/44719] zookeeper.ReadOnlyZKClient(139): Connect 0x7486e015 to 127.0.0.1:54158 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-07 12:14:35,566 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-03-07 12:14:35,575 DEBUG [Listener at localhost/44719] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e111295, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-07 12:14:35,575 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709813675575"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813675575"}]},"ts":"1709813675575"} 2024-03-07 12:14:35,579 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-07 12:14:35,582 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-07 12:14:35,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813675582"}]},"ts":"1709813675582"} 2024-03-07 12:14:35,586 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-03-07 12:14:35,608 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2024-03-07 12:14:35,608 DEBUG [hconnection-0x4f7dd605-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-07 12:14:35,610 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-07 12:14:35,610 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-07 12:14:35,610 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-07 12:14:35,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=7af7cbf8b716e08a8d591b578a21be05, ASSIGN}] 2024-03-07 12:14:35,613 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=7af7cbf8b716e08a8d591b578a21be05, ASSIGN 2024-03-07 12:14:35,614 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=7af7cbf8b716e08a8d591b578a21be05, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41591,1709813672309; forceNewPlan=false, retain=false 2024-03-07 12:14:35,621 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:32940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-07 12:14:35,630 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:14:35,631 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:35,635 DEBUG [Listener at localhost/44719] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-07 12:14:35,738 DEBUG [Listener at localhost/44719] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-07 12:14:35,765 INFO [jenkins-hbase16:37039] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-07 12:14:35,766 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7af7cbf8b716e08a8d591b578a21be05, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:35,766 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709813675766"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813675766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813675766"}]},"ts":"1709813675766"} 2024-03-07 12:14:35,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7af7cbf8b716e08a8d591b578a21be05, server=jenkins-hbase16.apache.org,41591,1709813672309}] 2024-03-07 12:14:35,840 DEBUG [Listener at localhost/44719] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-07 12:14:35,924 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:35,931 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:14:35,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7af7cbf8b716e08a8d591b578a21be05, NAME => 'hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05.', STARTKEY => '', ENDKEY => ''} 2024-03-07 12:14:35,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:35,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,934 INFO [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,937 DEBUG [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/q 2024-03-07 12:14:35,937 DEBUG [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/q 2024-03-07 12:14:35,938 INFO [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7af7cbf8b716e08a8d591b578a21be05 columnFamilyName q 2024-03-07 12:14:35,939 INFO [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] regionserver.HStore(310): Store=7af7cbf8b716e08a8d591b578a21be05/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:35,939 INFO [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,941 DEBUG [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/u 2024-03-07 12:14:35,942 DEBUG [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/u 2024-03-07 12:14:35,942 INFO [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7af7cbf8b716e08a8d591b578a21be05 columnFamilyName u 2024-03-07 12:14:35,943 DEBUG [Listener at localhost/44719] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-07 12:14:35,944 INFO [StoreOpener-7af7cbf8b716e08a8d591b578a21be05-1] regionserver.HStore(310): Store=7af7cbf8b716e08a8d591b578a21be05/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:35,946 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,947 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,950 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-03-07 12:14:35,952 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:14:35,956 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:35,957 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 7af7cbf8b716e08a8d591b578a21be05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69206450, jitterRate=0.03125646710395813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-03-07 12:14:35,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 7af7cbf8b716e08a8d591b578a21be05: 2024-03-07 12:14:35,958 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05., pid=11, masterSystemTime=1709813675923 2024-03-07 12:14:35,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:14:35,961 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:14:35,962 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7af7cbf8b716e08a8d591b578a21be05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:35,962 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709813675962"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1709813675962"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709813675962"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709813675962"}]},"ts":"1709813675962"} 2024-03-07 12:14:35,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-03-07 12:14:35,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7af7cbf8b716e08a8d591b578a21be05, server=jenkins-hbase16.apache.org,41591,1709813672309 in 195 msec 2024-03-07 12:14:35,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-03-07 12:14:35,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=7af7cbf8b716e08a8d591b578a21be05, ASSIGN in 358 msec 2024-03-07 12:14:35,975 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-07 12:14:35,975 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813675975"}]},"ts":"1709813675975"} 2024-03-07 12:14:35,978 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-03-07 12:14:36,015 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-03-07 12:14:36,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 529 msec 2024-03-07 12:14:36,058 DEBUG [Listener at localhost/44719] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-07 12:14:36,061 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-03-07 12:14:36,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$4(2118): Client=jenkins//188.40.62.62 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-07 12:14:36,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-03-07 12:14:36,098 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-07 12:14:36,100 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-07 12:14:36,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-03-07 12:14:36,103 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,104 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac empty. 2024-03-07 12:14:36,105 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,105 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-07 12:14:36,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-07 12:14:36,126 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-03-07 12:14:36,128 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8f20e49389eb113fd5cfa335d5dd76ac, NAME => 'TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp 2024-03-07 12:14:36,148 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:36,148 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 8f20e49389eb113fd5cfa335d5dd76ac, disabling compactions & flushes 2024-03-07 12:14:36,148 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:14:36,148 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:14:36,148 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. after waiting 0 ms 2024-03-07 12:14:36,148 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:14:36,148 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:14:36,148 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 8f20e49389eb113fd5cfa335d5dd76ac: 2024-03-07 12:14:36,153 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-03-07 12:14:36,156 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813676155"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813676155"}]},"ts":"1709813676155"} 2024-03-07 12:14:36,158 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-07 12:14:36,160 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-07 12:14:36,160 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813676160"}]},"ts":"1709813676160"} 2024-03-07 12:14:36,162 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-03-07 12:14:36,182 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2024-03-07 12:14:36,184 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-07 12:14:36,184 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-07 12:14:36,184 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-07 12:14:36,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=8f20e49389eb113fd5cfa335d5dd76ac, ASSIGN}] 2024-03-07 12:14:36,186 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=8f20e49389eb113fd5cfa335d5dd76ac, ASSIGN 2024-03-07 12:14:36,187 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=8f20e49389eb113fd5cfa335d5dd76ac, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,34997,1709813672259; forceNewPlan=false, retain=false 2024-03-07 12:14:36,338 INFO [jenkins-hbase16:37039] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-07 12:14:36,339 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8f20e49389eb113fd5cfa335d5dd76ac, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:36,339 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813676339"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813676339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813676339"}]},"ts":"1709813676339"} 2024-03-07 12:14:36,343 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 8f20e49389eb113fd5cfa335d5dd76ac, server=jenkins-hbase16.apache.org,34997,1709813672259}] 2024-03-07 12:14:36,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-07 12:14:36,496 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:36,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:14:36,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8f20e49389eb113fd5cfa335d5dd76ac, NAME => 'TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.', STARTKEY => '', ENDKEY => ''} 2024-03-07 12:14:36,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:36,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,507 INFO [StoreOpener-8f20e49389eb113fd5cfa335d5dd76ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,509 DEBUG [StoreOpener-8f20e49389eb113fd5cfa335d5dd76ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/cf 2024-03-07 12:14:36,510 DEBUG [StoreOpener-8f20e49389eb113fd5cfa335d5dd76ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/cf 2024-03-07 12:14:36,510 INFO [StoreOpener-8f20e49389eb113fd5cfa335d5dd76ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f20e49389eb113fd5cfa335d5dd76ac columnFamilyName cf 2024-03-07 12:14:36,511 INFO [StoreOpener-8f20e49389eb113fd5cfa335d5dd76ac-1] regionserver.HStore(310): Store=8f20e49389eb113fd5cfa335d5dd76ac/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:36,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:14:36,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:36,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 8f20e49389eb113fd5cfa335d5dd76ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68493931, jitterRate=0.02063910663127899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-07 12:14:36,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 8f20e49389eb113fd5cfa335d5dd76ac: 2024-03-07 12:14:36,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac., pid=14, masterSystemTime=1709813676496 2024-03-07 12:14:36,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:14:36,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:14:36,529 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8f20e49389eb113fd5cfa335d5dd76ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:36,530 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813676529"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1709813676529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709813676529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709813676529"}]},"ts":"1709813676529"} 2024-03-07 12:14:36,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-03-07 12:14:36,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 8f20e49389eb113fd5cfa335d5dd76ac, server=jenkins-hbase16.apache.org,34997,1709813672259 in 189 msec 2024-03-07 12:14:36,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-03-07 12:14:36,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=8f20e49389eb113fd5cfa335d5dd76ac, ASSIGN in 353 msec 2024-03-07 12:14:36,543 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-07 12:14:36,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813676543"}]},"ts":"1709813676543"} 2024-03-07 12:14:36,546 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-03-07 12:14:36,559 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-03-07 12:14:36,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 467 msec 2024-03-07 12:14:36,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-07 12:14:36,870 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-03-07 12:14:36,870 DEBUG [Listener at localhost/44719] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-03-07 12:14:36,871 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:36,875 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-03-07 12:14:36,876 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:36,876 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-03-07 12:14:36,876 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:36,887 DEBUG [hconnection-0x4f7dd605-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-07 12:14:36,890 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:44506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-07 12:14:36,895 DEBUG [regionserver/jenkins-hbase16:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-07 12:14:36,897 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-03-07 12:14:36,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$4(2118): Client=jenkins//188.40.62.62 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-07 12:14:36,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-03-07 12:14:36,903 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-07 12:14:36,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-03-07 12:14:36,906 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-07 12:14:36,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-07 12:14:36,909 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448 2024-03-07 12:14:36,910 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448 empty. 2024-03-07 12:14:36,910 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448 2024-03-07 12:14:36,910 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-07 12:14:36,934 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-03-07 12:14:36,935 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 641bb89917b108976a1febdeb140d448, NAME => 'TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp 2024-03-07 12:14:36,951 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:36,952 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 641bb89917b108976a1febdeb140d448, disabling compactions & flushes 2024-03-07 12:14:36,952 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:14:36,953 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:14:36,953 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. after waiting 0 ms 2024-03-07 12:14:36,953 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:14:36,953 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:14:36,953 DEBUG [hconnection-0x1bd93596-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-07 12:14:36,954 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 641bb89917b108976a1febdeb140d448: 2024-03-07 12:14:36,958 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:32946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-03-07 12:14:36,961 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-03-07 12:14:36,962 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813676962"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813676962"}]},"ts":"1709813676962"} 2024-03-07 12:14:36,965 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-07 12:14:36,966 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-07 12:14:36,967 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813676967"}]},"ts":"1709813676967"} 2024-03-07 12:14:36,970 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-03-07 12:14:37,016 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2024-03-07 12:14:37,017 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-07 12:14:37,017 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-07 12:14:37,017 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-07 12:14:37,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=641bb89917b108976a1febdeb140d448, ASSIGN}] 2024-03-07 12:14:37,019 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=641bb89917b108976a1febdeb140d448, ASSIGN 2024-03-07 12:14:37,021 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=641bb89917b108976a1febdeb140d448, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41591,1709813672309; forceNewPlan=false, retain=false 2024-03-07 12:14:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-07 12:14:37,171 INFO [jenkins-hbase16:37039] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-07 12:14:37,172 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=641bb89917b108976a1febdeb140d448, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:37,172 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813677172"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813677172"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813677172"}]},"ts":"1709813677172"} 2024-03-07 12:14:37,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 641bb89917b108976a1febdeb140d448, server=jenkins-hbase16.apache.org,41591,1709813672309}] 2024-03-07 12:14:37,329 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:37,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:14:37,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 641bb89917b108976a1febdeb140d448, NAME => 'TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.', STARTKEY => '', ENDKEY => ''} 2024-03-07 12:14:37,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 641bb89917b108976a1febdeb140d448 2024-03-07 12:14:37,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:37,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 641bb89917b108976a1febdeb140d448 2024-03-07 12:14:37,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 641bb89917b108976a1febdeb140d448 2024-03-07 12:14:37,339 INFO [StoreOpener-641bb89917b108976a1febdeb140d448-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 641bb89917b108976a1febdeb140d448 2024-03-07 12:14:37,342 DEBUG [StoreOpener-641bb89917b108976a1febdeb140d448-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448/cf 2024-03-07 12:14:37,342 DEBUG [StoreOpener-641bb89917b108976a1febdeb140d448-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448/cf 2024-03-07 12:14:37,343 INFO [StoreOpener-641bb89917b108976a1febdeb140d448-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 641bb89917b108976a1febdeb140d448 columnFamilyName cf 2024-03-07 12:14:37,344 INFO [StoreOpener-641bb89917b108976a1febdeb140d448-1] regionserver.HStore(310): Store=641bb89917b108976a1febdeb140d448/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:37,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448 2024-03-07 12:14:37,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448 2024-03-07 12:14:37,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 641bb89917b108976a1febdeb140d448 2024-03-07 12:14:37,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:37,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 641bb89917b108976a1febdeb140d448; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70248037, jitterRate=0.04677732288837433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-07 12:14:37,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 641bb89917b108976a1febdeb140d448: 2024-03-07 12:14:37,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448., pid=17, masterSystemTime=1709813677329 2024-03-07 12:14:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:14:37,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:14:37,368 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=641bb89917b108976a1febdeb140d448, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:37,368 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813677367"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1709813677367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709813677367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709813677367"}]},"ts":"1709813677367"} 2024-03-07 12:14:37,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-03-07 12:14:37,376 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 641bb89917b108976a1febdeb140d448, server=jenkins-hbase16.apache.org,41591,1709813672309 in 195 msec 2024-03-07 12:14:37,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-03-07 12:14:37,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=641bb89917b108976a1febdeb140d448, ASSIGN in 357 msec 2024-03-07 12:14:37,381 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-07 12:14:37,381 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813677381"}]},"ts":"1709813677381"} 2024-03-07 12:14:37,383 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-03-07 12:14:37,417 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-03-07 12:14:37,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 519 msec 2024-03-07 12:14:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-07 12:14:37,662 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-03-07 12:14:37,662 DEBUG [Listener at localhost/44719] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-03-07 12:14:37,662 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:37,666 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-03-07 12:14:37,667 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:37,667 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-03-07 12:14:37,667 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:37,679 DEBUG [regionserver/jenkins-hbase16:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-07 12:14:37,682 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 188.40.62.62:35680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-03-07 12:14:37,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$4(2118): Client=jenkins//188.40.62.62 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-07 12:14:37,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-03-07 12:14:37,687 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-07 12:14:37,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-03-07 12:14:37,689 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-07 12:14:37,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-07 12:14:37,692 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:37,693 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6 empty. 2024-03-07 12:14:37,694 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:37,694 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-07 12:14:37,718 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-03-07 12:14:37,720 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8220acd17d8a050dffe45a3f42b9d1c6, NAME => 'TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp 2024-03-07 12:14:37,738 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:37,739 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 8220acd17d8a050dffe45a3f42b9d1c6, disabling compactions & flushes 2024-03-07 12:14:37,739 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:14:37,739 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:14:37,739 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. after waiting 0 ms 2024-03-07 12:14:37,739 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:14:37,739 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:14:37,739 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 8220acd17d8a050dffe45a3f42b9d1c6: 2024-03-07 12:14:37,744 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-03-07 12:14:37,746 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813677746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813677746"}]},"ts":"1709813677746"} 2024-03-07 12:14:37,749 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-07 12:14:37,750 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-07 12:14:37,751 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813677750"}]},"ts":"1709813677750"} 2024-03-07 12:14:37,753 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-03-07 12:14:37,775 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2024-03-07 12:14:37,776 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-07 12:14:37,776 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-07 12:14:37,776 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-07 12:14:37,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=8220acd17d8a050dffe45a3f42b9d1c6, ASSIGN}] 2024-03-07 12:14:37,778 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=8220acd17d8a050dffe45a3f42b9d1c6, ASSIGN 2024-03-07 12:14:37,780 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=8220acd17d8a050dffe45a3f42b9d1c6, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41591,1709813672309; forceNewPlan=false, retain=false 2024-03-07 12:14:37,930 INFO [jenkins-hbase16:37039] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-07 12:14:37,931 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8220acd17d8a050dffe45a3f42b9d1c6, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:37,931 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813677931"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813677931"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813677931"}]},"ts":"1709813677931"} 2024-03-07 12:14:37,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 8220acd17d8a050dffe45a3f42b9d1c6, server=jenkins-hbase16.apache.org,41591,1709813672309}] 2024-03-07 12:14:37,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-07 12:14:38,088 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:38,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:14:38,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8220acd17d8a050dffe45a3f42b9d1c6, NAME => 'TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.', STARTKEY => '', ENDKEY => ''} 2024-03-07 12:14:38,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:38,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:38,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:38,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:38,098 INFO [StoreOpener-8220acd17d8a050dffe45a3f42b9d1c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:38,100 DEBUG [StoreOpener-8220acd17d8a050dffe45a3f42b9d1c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6/cf 2024-03-07 12:14:38,101 DEBUG [StoreOpener-8220acd17d8a050dffe45a3f42b9d1c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6/cf 2024-03-07 12:14:38,101 INFO [StoreOpener-8220acd17d8a050dffe45a3f42b9d1c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8220acd17d8a050dffe45a3f42b9d1c6 columnFamilyName cf 2024-03-07 12:14:38,102 INFO [StoreOpener-8220acd17d8a050dffe45a3f42b9d1c6-1] regionserver.HStore(310): Store=8220acd17d8a050dffe45a3f42b9d1c6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:38,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:38,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:38,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:14:38,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:38,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 8220acd17d8a050dffe45a3f42b9d1c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68424047, jitterRate=0.019597753882408142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-07 12:14:38,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 8220acd17d8a050dffe45a3f42b9d1c6: 2024-03-07 12:14:38,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6., pid=20, masterSystemTime=1709813678088 2024-03-07 12:14:38,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:14:38,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:14:38,120 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=8220acd17d8a050dffe45a3f42b9d1c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:38,120 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813678120"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1709813678120"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709813678120"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709813678120"}]},"ts":"1709813678120"} 2024-03-07 12:14:38,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-03-07 12:14:38,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 8220acd17d8a050dffe45a3f42b9d1c6, server=jenkins-hbase16.apache.org,41591,1709813672309 in 189 msec 2024-03-07 12:14:38,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-03-07 12:14:38,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=8220acd17d8a050dffe45a3f42b9d1c6, ASSIGN in 351 msec 2024-03-07 12:14:38,133 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-07 12:14:38,133 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813678133"}]},"ts":"1709813678133"} 2024-03-07 12:14:38,136 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-03-07 12:14:38,173 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-03-07 12:14:38,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 490 msec 2024-03-07 12:14:38,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-07 12:14:38,445 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-03-07 12:14:38,445 DEBUG [Listener at localhost/44719] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-03-07 12:14:38,445 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:38,449 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-03-07 12:14:38,449 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:38,449 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-03-07 12:14:38,449 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:38,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$15(3020): Client=jenkins//188.40.62.62 creating {NAME => 'TestNs'} 2024-03-07 12:14:38,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-03-07 12:14:38,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-07 12:14:38,514 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-07 12:14:38,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 62 msec 2024-03-07 12:14:38,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-07 12:14:38,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$4(2118): Client=jenkins//188.40.62.62 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-07 12:14:38,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-03-07 12:14:38,738 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-03-07 12:14:38,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(700): Client=jenkins//188.40.62.62 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-03-07 12:14:38,739 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-07 12:14:38,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-07 12:14:38,743 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:38,743 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:38,744 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700 empty. 2024-03-07 12:14:38,744 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3 empty. 2024-03-07 12:14:38,744 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:38,744 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:38,744 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-07 12:14:38,763 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-03-07 12:14:38,765 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4bdccafc617b387aff7261c1116043e3, NAME => 'TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp 2024-03-07 12:14:38,765 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 52a45db6cec97f3e97fc5c53c0444700, NAME => 'TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp 2024-03-07 12:14:38,793 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:38,794 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 4bdccafc617b387aff7261c1116043e3, disabling compactions & flushes 2024-03-07 12:14:38,794 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:14:38,794 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:14:38,794 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. after waiting 0 ms 2024-03-07 12:14:38,794 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:14:38,794 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:14:38,794 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:38,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 52a45db6cec97f3e97fc5c53c0444700, disabling compactions & flushes 2024-03-07 12:14:38,795 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:14:38,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 4bdccafc617b387aff7261c1116043e3: 2024-03-07 12:14:38,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:14:38,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. after waiting 0 ms 2024-03-07 12:14:38,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:14:38,795 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:14:38,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 52a45db6cec97f3e97fc5c53c0444700: 2024-03-07 12:14:38,801 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-03-07 12:14:38,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813678802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813678802"}]},"ts":"1709813678802"} 2024-03-07 12:14:38,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813678802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813678802"}]},"ts":"1709813678802"} 2024-03-07 12:14:38,809 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-03-07 12:14:38,811 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-07 12:14:38,811 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813678811"}]},"ts":"1709813678811"} 2024-03-07 12:14:38,813 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-03-07 12:14:38,857 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase16.apache.org=0} racks are {/default-rack=0} 2024-03-07 12:14:38,860 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-07 12:14:38,860 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-07 12:14:38,860 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-07 12:14:38,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=52a45db6cec97f3e97fc5c53c0444700, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=4bdccafc617b387aff7261c1116043e3, ASSIGN}] 2024-03-07 12:14:38,863 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=4bdccafc617b387aff7261c1116043e3, ASSIGN 2024-03-07 12:14:38,863 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=52a45db6cec97f3e97fc5c53c0444700, ASSIGN 2024-03-07 12:14:38,865 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=4bdccafc617b387aff7261c1116043e3, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,34997,1709813672259; forceNewPlan=false, retain=false 2024-03-07 12:14:38,865 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=52a45db6cec97f3e97fc5c53c0444700, ASSIGN; state=OFFLINE, location=jenkins-hbase16.apache.org,41591,1709813672309; forceNewPlan=false, retain=false 2024-03-07 12:14:38,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-07 12:14:39,015 INFO [jenkins-hbase16:37039] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-03-07 12:14:39,017 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=52a45db6cec97f3e97fc5c53c0444700, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:39,017 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=4bdccafc617b387aff7261c1116043e3, regionState=OPENING, regionLocation=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:39,017 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813679017"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813679017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813679017"}]},"ts":"1709813679017"} 2024-03-07 12:14:39,017 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813679017"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813679017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813679017"}]},"ts":"1709813679017"} 2024-03-07 12:14:39,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure 52a45db6cec97f3e97fc5c53c0444700, server=jenkins-hbase16.apache.org,41591,1709813672309}] 2024-03-07 12:14:39,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure 4bdccafc617b387aff7261c1116043e3, server=jenkins-hbase16.apache.org,34997,1709813672259}] 2024-03-07 12:14:39,173 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:39,175 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:39,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:14:39,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52a45db6cec97f3e97fc5c53c0444700, NAME => 'TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.', STARTKEY => '', ENDKEY => '1'} 2024-03-07 12:14:39,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:39,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:39,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:39,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:39,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:14:39,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4bdccafc617b387aff7261c1116043e3, NAME => 'TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.', STARTKEY => '1', ENDKEY => ''} 2024-03-07 12:14:39,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:39,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-07 12:14:39,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7894): checking encryption for 4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:39,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(7897): checking classloading for 4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:39,184 INFO [StoreOpener-52a45db6cec97f3e97fc5c53c0444700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:39,185 INFO [StoreOpener-4bdccafc617b387aff7261c1116043e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:39,189 DEBUG [StoreOpener-52a45db6cec97f3e97fc5c53c0444700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700/cf 2024-03-07 12:14:39,190 DEBUG [StoreOpener-52a45db6cec97f3e97fc5c53c0444700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700/cf 2024-03-07 12:14:39,190 INFO [StoreOpener-52a45db6cec97f3e97fc5c53c0444700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52a45db6cec97f3e97fc5c53c0444700 columnFamilyName cf 2024-03-07 12:14:39,191 DEBUG [StoreOpener-4bdccafc617b387aff7261c1116043e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3/cf 2024-03-07 12:14:39,191 DEBUG [StoreOpener-4bdccafc617b387aff7261c1116043e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3/cf 2024-03-07 12:14:39,191 INFO [StoreOpener-4bdccafc617b387aff7261c1116043e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4bdccafc617b387aff7261c1116043e3 columnFamilyName cf 2024-03-07 12:14:39,192 INFO [StoreOpener-52a45db6cec97f3e97fc5c53c0444700-1] regionserver.HStore(310): Store=52a45db6cec97f3e97fc5c53c0444700/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:39,195 INFO [StoreOpener-4bdccafc617b387aff7261c1116043e3-1] regionserver.HStore(310): Store=4bdccafc617b387aff7261c1116043e3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-07 12:14:39,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:39,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:39,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:39,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:39,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:14:39,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1055): writing seq id for 4bdccafc617b387aff7261c1116043e3 2024-03-07 12:14:39,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:39,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 52a45db6cec97f3e97fc5c53c0444700; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71974511, jitterRate=0.07250379025936127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-07 12:14:39,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 52a45db6cec97f3e97fc5c53c0444700: 2024-03-07 12:14:39,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-07 12:14:39,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1072): Opened 4bdccafc617b387aff7261c1116043e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74035517, jitterRate=0.10321517288684845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-07 12:14:39,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(965): Region open journal for 4bdccafc617b387aff7261c1116043e3: 2024-03-07 12:14:39,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700., pid=25, masterSystemTime=1709813679173 2024-03-07 12:14:39,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3., pid=26, masterSystemTime=1709813679175 2024-03-07 12:14:39,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:14:39,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:14:39,216 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=52a45db6cec97f3e97fc5c53c0444700, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:14:39,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:14:39,216 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813679216"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1709813679216"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709813679216"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709813679216"}]},"ts":"1709813679216"} 2024-03-07 12:14:39,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase16:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:14:39,217 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=4bdccafc617b387aff7261c1116043e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:14:39,218 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813679217"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1709813679217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709813679217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709813679217"}]},"ts":"1709813679217"} 2024-03-07 12:14:39,224 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-03-07 12:14:39,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-03-07 12:14:39,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure 52a45db6cec97f3e97fc5c53c0444700, server=jenkins-hbase16.apache.org,41591,1709813672309 in 200 msec 2024-03-07 12:14:39,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=52a45db6cec97f3e97fc5c53c0444700, ASSIGN in 363 msec 2024-03-07 12:14:39,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure 4bdccafc617b387aff7261c1116043e3, server=jenkins-hbase16.apache.org,34997,1709813672259 in 201 msec 2024-03-07 12:14:39,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-03-07 12:14:39,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=4bdccafc617b387aff7261c1116043e3, ASSIGN in 365 msec 2024-03-07 12:14:39,232 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-07 12:14:39,232 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813679232"}]},"ts":"1709813679232"} 2024-03-07 12:14:39,235 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-03-07 12:14:39,276 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-03-07 12:14:39,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 543 msec 2024-03-07 12:14:39,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-07 12:14:39,494 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-03-07 12:14:39,494 DEBUG [Listener at localhost/44719] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-03-07 12:14:39,495 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:39,499 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-03-07 12:14:39,499 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:39,499 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-03-07 12:14:39,499 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:39,546 INFO [Listener at localhost/44719] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=303, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=166, AvailableMemoryMB=5419 2024-03-07 12:14:39,661 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-03-07 12:14:39,767 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-03-07 12:14:39,768 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-03-07 12:14:39,768 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-03-07 12:14:39,769 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-03-07 12:14:39,769 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-03-07 12:14:39,770 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-03-07 12:14:39,770 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-03-07 12:14:39,838 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:39,838 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:14:39,838 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709817279586 bypass), TestNs=QuotaState(ts=1709817279586 bypass)} 2024-03-07 12:14:39,838 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709817279586 bypass), TestNs:TestTable=QuotaState(ts=1709817279586 bypass)} 2024-03-07 12:14:39,838 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709817279586 [ TestNs:TestTable ])} 2024-03-07 12:14:39,838 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709817279586 bypass)} 2024-03-07 12:14:40,089 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:40,089 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:14:40,089 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709817279586 bypass), TestNs=QuotaState(ts=1709817279586 bypass)} 2024-03-07 12:14:40,089 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709817279586 bypass), TestQuotaAdmin2=QuotaState(ts=1709817279586 bypass), TestQuotaAdmin1=QuotaState(ts=1709817279586 bypass)} 2024-03-07 12:14:40,089 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709817279586 [ TestNs:TestTable ])} 2024-03-07 12:14:40,089 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709817279586 bypass)} 2024-03-07 12:14:40,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:40,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813690110, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:40,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:40,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813690111, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:40,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:40,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813690111, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:41,198 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-07 12:14:41,198 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-03-07 12:14:41,199 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-07 12:14:41,199 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-03-07 12:14:41,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:41,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813690110, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:42,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:42,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813690110, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:44,684 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-03-07 12:14:45,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:45,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813690111, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:45,416 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10353: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:14:45,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:45,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 188.40.62.62:44506 deadline: 1709813695419, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 188.40.62.62:44506 deadline: 1709813695419, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:46,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:46,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 188.40.62.62:44506 deadline: 1709813695419, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:46,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:46,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 188.40.62.62:44506 deadline: 1709813695419, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:48,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:48,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 188.40.62.62:44506 deadline: 1709813695419, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:50,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:50,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 188.40.62.62:44506 deadline: 1709813695419, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:14:50,725 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10344: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:14:50,985 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:50,986 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:14:50,986 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709820879586 bypass), TestNs=QuotaState(ts=1709820879586 bypass)} 2024-03-07 12:14:50,986 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709820879586 bypass), TestNs:TestTable=QuotaState(ts=1709820879586 bypass)} 2024-03-07 12:14:50,986 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709820879586 bypass)} 2024-03-07 12:14:50,986 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709820879586 bypass)} 2024-03-07 12:14:51,236 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:51,237 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:14:51,237 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709820879586 bypass), TestNs=QuotaState(ts=1709820879586 bypass)} 2024-03-07 12:14:51,237 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709820879586 bypass), TestQuotaAdmin2=QuotaState(ts=1709820879586 bypass), TestQuotaAdmin1=QuotaState(ts=1709820879586 bypass)} 2024-03-07 12:14:51,237 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709820879586 bypass)} 2024-03-07 12:14:51,237 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709820879586 bypass)} 2024-03-07 12:14:51,252 INFO [Listener at localhost/44719] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=289 (was 303), OpenFileDescriptor=598 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 330), ProcessCount=166 (was 166), AvailableMemoryMB=5350 (was 5419) 2024-03-07 12:14:51,265 INFO [Listener at localhost/44719] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=289, OpenFileDescriptor=598, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=166, AvailableMemoryMB=5349 2024-03-07 12:14:51,530 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:51,530 INFO [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-07 12:14:51,781 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:14:51,782 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709824479686 bypass), TestNs=QuotaState(ts=1709824479686 bypass)} 2024-03-07 12:14:51,783 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709824479686 bypass), TestNs:TestTable=QuotaState(ts=1709824479686 bypass)} 2024-03-07 12:14:51,783 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709824479686 [ default ])} 2024-03-07 12:14:51,784 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709824479686 bypass)} 2024-03-07 12:14:52,034 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:14:52,034 INFO [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-07 12:14:52,285 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:14:52,286 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709824479786 bypass), TestNs=QuotaState(ts=1709824479786 bypass)} 2024-03-07 12:14:52,288 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709824479786 bypass), TestQuotaAdmin2=QuotaState(ts=1709824479786 bypass), TestQuotaAdmin1=QuotaState(ts=1709824479786 bypass)} 2024-03-07 12:14:52,288 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709824479786 [ default ])} 2024-03-07 12:14:52,288 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709824479786 bypass)} 2024-03-07 12:14:52,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:52,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 188.40.62.62:44506 deadline: 1709813702300, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:52,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:52,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 188.40.62.62:44506 deadline: 1709813702300, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:53,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:53,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 188.40.62.62:44506 deadline: 1709813702300, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:53,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:53,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813702300, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:55,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:55,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813702299, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:57,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:57,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813702300, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-07 12:14:57,611 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10318: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:14:57,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:14:57,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813707631, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:14:57,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:14:57,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813707630, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:14:58,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:14:58,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813707631, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:14:59,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:14:59,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813707631, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:00,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:00,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813707631, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:02,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:02,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813707631, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:02,943 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10314: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:15:03,201 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:03,201 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:03,201 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709828079786 bypass), TestNs=QuotaState(ts=1709828079786 bypass)} 2024-03-07 12:15:03,201 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709828079786 bypass), TestNs:TestTable=QuotaState(ts=1709828079786 bypass)} 2024-03-07 12:15:03,202 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709828079786 bypass)} 2024-03-07 12:15:03,202 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709828079786 bypass)} 2024-03-07 12:15:03,452 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:03,452 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:03,452 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709828079786 bypass), TestNs=QuotaState(ts=1709828079786 bypass)} 2024-03-07 12:15:03,452 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709828079786 bypass), TestQuotaAdmin2=QuotaState(ts=1709828079786 bypass), TestQuotaAdmin1=QuotaState(ts=1709828079786 bypass)} 2024-03-07 12:15:03,452 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709828079786 bypass)} 2024-03-07 12:15:03,453 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709828079786 bypass)} 2024-03-07 12:15:03,466 INFO [Listener at localhost/44719] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=289 (was 289), OpenFileDescriptor=597 (was 598), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 279), ProcessCount=168 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=5344 (was 5349) 2024-03-07 12:15:03,478 INFO [Listener at localhost/44719] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=289, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=168, AvailableMemoryMB=5344 2024-03-07 12:15:03,741 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:03,742 INFO [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-07 12:15:03,992 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:03,993 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709831679886 bypass), TestNs=QuotaState(ts=1709831679886 bypass)} 2024-03-07 12:15:03,993 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709831679886 bypass), TestNs:TestTable=QuotaState(ts=1709831679886 bypass)} 2024-03-07 12:15:03,994 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709831679886 global-limiter)} 2024-03-07 12:15:03,994 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709831679886 bypass)} 2024-03-07 12:15:04,244 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:04,244 INFO [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-07 12:15:04,495 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:04,496 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709831679986 bypass), TestNs=QuotaState(ts=1709831679986 bypass)} 2024-03-07 12:15:04,498 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709831679986 bypass), TestQuotaAdmin2=QuotaState(ts=1709831679986 bypass), TestQuotaAdmin1=QuotaState(ts=1709831679986 bypass)} 2024-03-07 12:15:04,498 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709831679986 global-limiter)} 2024-03-07 12:15:04,498 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709831679986 bypass)} 2024-03-07 12:15:04,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:04,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813714518, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:04,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:04,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813714517, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:05,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:05,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813714517, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:06,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:06,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813714517, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:07,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:07,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813714518, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:09,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:09,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813714518, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:09,832 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10339: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:15:09,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:09,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813719840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:10,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:10,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813719840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:10,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:10,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813719840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:11,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:11,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813719840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:12,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:12,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813719840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:15,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:15,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813719840, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-07 12:15:15,142 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10317: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:15:15,399 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:15,400 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:15,400 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709835279986 bypass), TestNs=QuotaState(ts=1709835279986 bypass)} 2024-03-07 12:15:15,400 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709835279986 bypass), TestNs:TestTable=QuotaState(ts=1709835279986 bypass)} 2024-03-07 12:15:15,400 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709835279986 bypass)} 2024-03-07 12:15:15,400 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709835279986 bypass)} 2024-03-07 12:15:15,650 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:15,651 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:15,651 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709835279986 bypass), TestNs=QuotaState(ts=1709835279986 bypass)} 2024-03-07 12:15:15,651 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709835279986 bypass), TestQuotaAdmin2=QuotaState(ts=1709835279986 bypass), TestQuotaAdmin1=QuotaState(ts=1709835279986 bypass)} 2024-03-07 12:15:15,651 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709835279986 bypass)} 2024-03-07 12:15:15,651 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709835279986 bypass)} 2024-03-07 12:15:15,663 INFO [Listener at localhost/44719] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=280 (was 289), OpenFileDescriptor=595 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 250), ProcessCount=165 (was 168), AvailableMemoryMB=5343 (was 5344) 2024-03-07 12:15:15,675 INFO [Listener at localhost/44719] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=218, ProcessCount=165, AvailableMemoryMB=5342 2024-03-07 12:15:15,935 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:15,936 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:15,936 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709838879986 bypass), TestNs=QuotaState(ts=1709838879986 bypass)} 2024-03-07 12:15:15,937 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709838879986 bypass), TestNs:TestTable=QuotaState(ts=1709838879986 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000)))} 2024-03-07 12:15:15,937 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-07 12:15:15,938 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709838879986 bypass)} 2024-03-07 12:15:16,188 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:16,190 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:16,190 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709838879986 bypass), TestNs=QuotaState(ts=1709838879986 bypass)} 2024-03-07 12:15:16,190 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709838879986 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1709838879986 bypass), TestQuotaAdmin1=QuotaState(ts=1709838879986 bypass)} 2024-03-07 12:15:16,190 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-07 12:15:16,190 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709838879986 bypass)} 2024-03-07 12:15:16,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:16,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 188.40.62.62:44506 deadline: 1709813726208, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:16,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:16,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 188.40.62.62:44506 deadline: 1709813726208, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:16,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:16,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 188.40.62.62:44506 deadline: 1709813726207, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:17,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:17,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 188.40.62.62:44506 deadline: 1709813726207, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:18,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:18,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 188.40.62.62:44506 deadline: 1709813726207, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:21,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:21,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 188.40.62.62:44506 deadline: 1709813726208, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:21,506 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10318: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:15:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813731508, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:21,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:21,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813731508, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:22,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:22,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813731508, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:23,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:23,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813731508, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:24,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:24,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813731508, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:26,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:26,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 188.40.62.62:44506 deadline: 1709813731508, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-07 12:15:26,811 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10331: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:15:27,078 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:27,078 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:27,078 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709842479986 bypass), TestNs=QuotaState(ts=1709842479986 bypass)} 2024-03-07 12:15:27,079 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709842479986 bypass), TestNs:TestTable=QuotaState(ts=1709842479986 bypass)} 2024-03-07 12:15:27,079 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709842479986 bypass)} 2024-03-07 12:15:27,079 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709842479986 bypass)} 2024-03-07 12:15:27,329 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:27,329 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:27,329 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709842479986 bypass), TestNs=QuotaState(ts=1709842479986 bypass)} 2024-03-07 12:15:27,329 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709842479986 bypass), TestQuotaAdmin2=QuotaState(ts=1709842479986 bypass), TestQuotaAdmin1=QuotaState(ts=1709842479986 bypass)} 2024-03-07 12:15:27,329 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-07 12:15:27,329 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709842479986 bypass)} 2024-03-07 12:15:27,340 INFO [Listener at localhost/44719] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280 (was 280), OpenFileDescriptor=595 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 218) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=5341 (was 5342) 2024-03-07 12:15:27,353 INFO [Listener at localhost/44719] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=280, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=165, AvailableMemoryMB=5341 2024-03-07 12:15:27,616 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:27,616 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:27,617 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709846079986 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1709846079986 bypass)} 2024-03-07 12:15:27,617 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709846079986 bypass), TestNs:TestTable=QuotaState(ts=1709846079986 bypass)} 2024-03-07 12:15:27,618 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-07 12:15:27,618 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709846079986 bypass)} 2024-03-07 12:15:27,868 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:27,868 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:27,869 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709846079986 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1709846079986 bypass)} 2024-03-07 12:15:27,870 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709846079986 bypass), TestQuotaAdmin2=QuotaState(ts=1709846079986 bypass), TestQuotaAdmin1=QuotaState(ts=1709846079986 bypass)} 2024-03-07 12:15:27,870 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-07 12:15:27,870 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709846079986 bypass)} 2024-03-07 12:15:27,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:27,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813737887, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:28,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:28,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813737888, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:28,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:28,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813737888, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:29,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:29,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813737887, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:30,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:30,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813737888, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:33,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:33,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 188.40.62.62:44506 deadline: 1709813737888, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-07 12:15:33,175 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10328: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:15:33,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:33,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813743185, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:33,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:33,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813743185, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:33,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:33,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813743185, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:34,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:34,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813743185, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:35,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:35,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813743185, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:38,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:38,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34997] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 188.40.62.62:44506 deadline: 1709813743186, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-07 12:15:38,473 ERROR [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10309: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac., hostname=jenkins-hbase16.apache.org,34997,1709813672259, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-07 12:15:38,731 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:38,731 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:38,732 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709849679986 bypass), TestNs=QuotaState(ts=1709849679986 bypass)} 2024-03-07 12:15:38,732 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709849679986 bypass), TestNs:TestTable=QuotaState(ts=1709849679986 bypass)} 2024-03-07 12:15:38,732 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709849679986 bypass)} 2024-03-07 12:15:38,732 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709849679986 bypass)} 2024-03-07 12:15:38,982 INFO [Listener at localhost/44719] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-07 12:15:38,982 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-07 12:15:38,982 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709849679986 bypass), TestNs=QuotaState(ts=1709849679986 bypass)} 2024-03-07 12:15:38,982 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709849679986 bypass), TestQuotaAdmin2=QuotaState(ts=1709849679986 bypass), TestQuotaAdmin1=QuotaState(ts=1709849679986 bypass)} 2024-03-07 12:15:38,982 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-07 12:15:38,982 DEBUG [Listener at localhost/44719] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709849679986 bypass)} 2024-03-07 12:15:38,994 INFO [Listener at localhost/44719] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 280), OpenFileDescriptor=583 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 250), ProcessCount=165 (was 165), AvailableMemoryMB=5339 (was 5341) 2024-03-07 12:15:38,997 INFO [Listener at localhost/44719] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-03-07 12:15:39,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$11(2424): Client=jenkins//188.40.62.62 disable TestQuotaAdmin0 2024-03-07 12:15:39,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-03-07 12:15:39,013 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813739013"}]},"ts":"1709813739013"} 2024-03-07 12:15:39,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-07 12:15:39,015 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-03-07 12:15:39,052 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-03-07 12:15:39,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=8f20e49389eb113fd5cfa335d5dd76ac, UNASSIGN}] 2024-03-07 12:15:39,056 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=8f20e49389eb113fd5cfa335d5dd76ac, UNASSIGN 2024-03-07 12:15:39,057 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8f20e49389eb113fd5cfa335d5dd76ac, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:15:39,057 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813739057"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813739057"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813739057"}]},"ts":"1709813739057"} 2024-03-07 12:15:39,059 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 8f20e49389eb113fd5cfa335d5dd76ac, server=jenkins-hbase16.apache.org,34997,1709813672259}] 2024-03-07 12:15:39,176 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase16.apache.org,34997,1709813672259, timeout=1709813739216, delay=40, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 8f20e49389eb113fd5cfa335d5dd76ac, server=jenkins-hbase16.apache.org,34997,1709813672259]] 2024-03-07 12:15:39,218 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:15:39,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:15:39,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 8f20e49389eb113fd5cfa335d5dd76ac, disabling compactions & flushes 2024-03-07 12:15:39,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:15:39,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:15:39,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. after waiting 0 ms 2024-03-07 12:15:39,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:15:39,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 8f20e49389eb113fd5cfa335d5dd76ac 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-03-07 12:15:39,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-07 12:15:39,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/.tmp/cf/ec6eaee85bd94ca781b578d5b114da52 2024-03-07 12:15:39,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/.tmp/cf/ec6eaee85bd94ca781b578d5b114da52 as hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/cf/ec6eaee85bd94ca781b578d5b114da52 2024-03-07 12:15:39,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/cf/ec6eaee85bd94ca781b578d5b114da52, entries=6, sequenceid=21, filesize=4.7 K 2024-03-07 12:15:39,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 8f20e49389eb113fd5cfa335d5dd76ac in 133ms, sequenceid=21, compaction requested=false 2024-03-07 12:15:39,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-03-07 12:15:39,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac. 2024-03-07 12:15:39,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 8f20e49389eb113fd5cfa335d5dd76ac: 2024-03-07 12:15:39,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:15:39,370 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8f20e49389eb113fd5cfa335d5dd76ac, regionState=CLOSED 2024-03-07 12:15:39,370 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813739370"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813739370"}]},"ts":"1709813739370"} 2024-03-07 12:15:39,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-03-07 12:15:39,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 8f20e49389eb113fd5cfa335d5dd76ac, server=jenkins-hbase16.apache.org,34997,1709813672259 in 313 msec 2024-03-07 12:15:39,377 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-03-07 12:15:39,377 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=8f20e49389eb113fd5cfa335d5dd76ac, UNASSIGN in 320 msec 2024-03-07 12:15:39,378 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813739378"}]},"ts":"1709813739378"} 2024-03-07 12:15:39,380 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-03-07 12:15:39,419 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-03-07 12:15:39,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 417 msec 2024-03-07 12:15:39,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-07 12:15:39,768 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-03-07 12:15:39,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$5(2234): Client=jenkins//188.40.62.62 delete TestQuotaAdmin0 2024-03-07 12:15:39,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-07 12:15:39,782 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-07 12:15:39,784 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-07 12:15:39,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-07 12:15:39,791 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:15:39,797 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/cf, FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/recovered.edits] 2024-03-07 12:15:39,806 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/cf/ec6eaee85bd94ca781b578d5b114da52 to hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/archive/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/cf/ec6eaee85bd94ca781b578d5b114da52 2024-03-07 12:15:39,812 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/recovered.edits/24.seqid to hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/archive/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac/recovered.edits/24.seqid 2024-03-07 12:15:39,814 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin0/8f20e49389eb113fd5cfa335d5dd76ac 2024-03-07 12:15:39,814 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-07 12:15:39,817 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-07 12:15:39,835 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-03-07 12:15:39,838 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-03-07 12:15:39,840 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-07 12:15:39,840 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-03-07 12:15:39,840 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709813739840"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:39,842 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-07 12:15:39,843 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8f20e49389eb113fd5cfa335d5dd76ac, NAME => 'TestQuotaAdmin0,,1709813676088.8f20e49389eb113fd5cfa335d5dd76ac.', STARTKEY => '', ENDKEY => ''}] 2024-03-07 12:15:39,843 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-03-07 12:15:39,843 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709813739843"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:39,846 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-03-07 12:15:39,881 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-07 12:15:39,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 108 msec 2024-03-07 12:15:40,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-07 12:15:40,042 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-03-07 12:15:40,042 INFO [Listener at localhost/44719] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-03-07 12:15:40,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$11(2424): Client=jenkins//188.40.62.62 disable TestQuotaAdmin1 2024-03-07 12:15:40,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-03-07 12:15:40,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-07 12:15:40,048 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813740048"}]},"ts":"1709813740048"} 2024-03-07 12:15:40,050 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-03-07 12:15:40,060 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-03-07 12:15:40,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=641bb89917b108976a1febdeb140d448, UNASSIGN}] 2024-03-07 12:15:40,064 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=641bb89917b108976a1febdeb140d448, UNASSIGN 2024-03-07 12:15:40,065 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=641bb89917b108976a1febdeb140d448, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:40,065 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813740065"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813740065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813740065"}]},"ts":"1709813740065"} 2024-03-07 12:15:40,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 641bb89917b108976a1febdeb140d448, server=jenkins-hbase16.apache.org,41591,1709813672309}] 2024-03-07 12:15:40,220 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:40,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 641bb89917b108976a1febdeb140d448 2024-03-07 12:15:40,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 641bb89917b108976a1febdeb140d448, disabling compactions & flushes 2024-03-07 12:15:40,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:15:40,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:15:40,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. after waiting 0 ms 2024-03-07 12:15:40,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:15:40,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-07 12:15:40,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448. 2024-03-07 12:15:40,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 641bb89917b108976a1febdeb140d448: 2024-03-07 12:15:40,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 641bb89917b108976a1febdeb140d448 2024-03-07 12:15:40,235 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=641bb89917b108976a1febdeb140d448, regionState=CLOSED 2024-03-07 12:15:40,236 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813740235"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813740235"}]},"ts":"1709813740235"} 2024-03-07 12:15:40,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-03-07 12:15:40,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 641bb89917b108976a1febdeb140d448, server=jenkins-hbase16.apache.org,41591,1709813672309 in 170 msec 2024-03-07 12:15:40,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-03-07 12:15:40,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=641bb89917b108976a1febdeb140d448, UNASSIGN in 178 msec 2024-03-07 12:15:40,244 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813740244"}]},"ts":"1709813740244"} 2024-03-07 12:15:40,246 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-03-07 12:15:40,255 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-03-07 12:15:40,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 213 msec 2024-03-07 12:15:40,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-07 12:15:40,299 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-03-07 12:15:40,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$5(2234): Client=jenkins//188.40.62.62 delete TestQuotaAdmin1 2024-03-07 12:15:40,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-07 12:15:40,304 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-07 12:15:40,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-07 12:15:40,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-07 12:15:40,311 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448 2024-03-07 12:15:40,314 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448/cf, FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448/recovered.edits] 2024-03-07 12:15:40,324 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448/recovered.edits/4.seqid to hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/archive/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448/recovered.edits/4.seqid 2024-03-07 12:15:40,325 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin1/641bb89917b108976a1febdeb140d448 2024-03-07 12:15:40,325 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-07 12:15:40,328 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-07 12:15:40,331 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-03-07 12:15:40,333 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-03-07 12:15:40,335 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-07 12:15:40,335 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-03-07 12:15:40,335 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709813740335"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:40,337 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-07 12:15:40,337 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 641bb89917b108976a1febdeb140d448, NAME => 'TestQuotaAdmin1,,1709813676898.641bb89917b108976a1febdeb140d448.', STARTKEY => '', ENDKEY => ''}] 2024-03-07 12:15:40,337 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-03-07 12:15:40,338 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709813740337"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:40,340 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-03-07 12:15:40,348 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-07 12:15:40,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 48 msec 2024-03-07 12:15:40,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-07 12:15:40,558 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-03-07 12:15:40,559 INFO [Listener at localhost/44719] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-03-07 12:15:40,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$11(2424): Client=jenkins//188.40.62.62 disable TestQuotaAdmin2 2024-03-07 12:15:40,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-03-07 12:15:40,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-07 12:15:40,565 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813740565"}]},"ts":"1709813740565"} 2024-03-07 12:15:40,567 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-03-07 12:15:40,580 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-03-07 12:15:40,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=8220acd17d8a050dffe45a3f42b9d1c6, UNASSIGN}] 2024-03-07 12:15:40,582 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=8220acd17d8a050dffe45a3f42b9d1c6, UNASSIGN 2024-03-07 12:15:40,584 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8220acd17d8a050dffe45a3f42b9d1c6, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:40,584 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813740584"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813740584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813740584"}]},"ts":"1709813740584"} 2024-03-07 12:15:40,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 8220acd17d8a050dffe45a3f42b9d1c6, server=jenkins-hbase16.apache.org,41591,1709813672309}] 2024-03-07 12:15:40,738 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:40,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:15:40,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 8220acd17d8a050dffe45a3f42b9d1c6, disabling compactions & flushes 2024-03-07 12:15:40,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:15:40,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:15:40,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. after waiting 0 ms 2024-03-07 12:15:40,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:15:40,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-07 12:15:40,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6. 2024-03-07 12:15:40,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 8220acd17d8a050dffe45a3f42b9d1c6: 2024-03-07 12:15:40,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:15:40,750 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8220acd17d8a050dffe45a3f42b9d1c6, regionState=CLOSED 2024-03-07 12:15:40,750 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709813740750"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813740750"}]},"ts":"1709813740750"} 2024-03-07 12:15:40,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-03-07 12:15:40,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 8220acd17d8a050dffe45a3f42b9d1c6, server=jenkins-hbase16.apache.org,41591,1709813672309 in 166 msec 2024-03-07 12:15:40,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-03-07 12:15:40,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=8220acd17d8a050dffe45a3f42b9d1c6, UNASSIGN in 174 msec 2024-03-07 12:15:40,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813740758"}]},"ts":"1709813740758"} 2024-03-07 12:15:40,760 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-03-07 12:15:40,771 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-03-07 12:15:40,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 213 msec 2024-03-07 12:15:40,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-07 12:15:40,816 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-03-07 12:15:40,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$5(2234): Client=jenkins//188.40.62.62 delete TestQuotaAdmin2 2024-03-07 12:15:40,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-07 12:15:40,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-07 12:15:40,822 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-07 12:15:40,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-07 12:15:40,827 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:15:40,829 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6/cf, FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6/recovered.edits] 2024-03-07 12:15:40,837 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6/recovered.edits/4.seqid to hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/archive/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6/recovered.edits/4.seqid 2024-03-07 12:15:40,838 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/default/TestQuotaAdmin2/8220acd17d8a050dffe45a3f42b9d1c6 2024-03-07 12:15:40,838 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-07 12:15:40,841 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-07 12:15:40,843 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-03-07 12:15:40,845 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-03-07 12:15:40,847 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-07 12:15:40,847 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-03-07 12:15:40,848 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709813740847"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:40,850 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-07 12:15:40,850 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8220acd17d8a050dffe45a3f42b9d1c6, NAME => 'TestQuotaAdmin2,,1709813677682.8220acd17d8a050dffe45a3f42b9d1c6.', STARTKEY => '', ENDKEY => ''}] 2024-03-07 12:15:40,850 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-03-07 12:15:40,850 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709813740850"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:40,852 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-03-07 12:15:40,864 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-07 12:15:40,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 47 msec 2024-03-07 12:15:41,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-07 12:15:41,076 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-03-07 12:15:41,077 INFO [Listener at localhost/44719] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-03-07 12:15:41,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$11(2424): Client=jenkins//188.40.62.62 disable TestNs:TestTable 2024-03-07 12:15:41,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-03-07 12:15:41,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-07 12:15:41,082 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813741082"}]},"ts":"1709813741082"} 2024-03-07 12:15:41,085 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-03-07 12:15:41,096 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-03-07 12:15:41,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=52a45db6cec97f3e97fc5c53c0444700, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=4bdccafc617b387aff7261c1116043e3, UNASSIGN}] 2024-03-07 12:15:41,099 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=4bdccafc617b387aff7261c1116043e3, UNASSIGN 2024-03-07 12:15:41,099 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=52a45db6cec97f3e97fc5c53c0444700, UNASSIGN 2024-03-07 12:15:41,100 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=4bdccafc617b387aff7261c1116043e3, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:15:41,100 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=52a45db6cec97f3e97fc5c53c0444700, regionState=CLOSING, regionLocation=jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:41,100 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813741100"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813741100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813741100"}]},"ts":"1709813741100"} 2024-03-07 12:15:41,100 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813741100"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1709813741100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709813741100"}]},"ts":"1709813741100"} 2024-03-07 12:15:41,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure 52a45db6cec97f3e97fc5c53c0444700, server=jenkins-hbase16.apache.org,41591,1709813672309}] 2024-03-07 12:15:41,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure 4bdccafc617b387aff7261c1116043e3, server=jenkins-hbase16.apache.org,34997,1709813672259}] 2024-03-07 12:15:41,254 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:41,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:15:41,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 52a45db6cec97f3e97fc5c53c0444700, disabling compactions & flushes 2024-03-07 12:15:41,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:15:41,256 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:15:41,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:15:41,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. after waiting 0 ms 2024-03-07 12:15:41,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:15:41,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(111): Close 4bdccafc617b387aff7261c1116043e3 2024-03-07 12:15:41,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 4bdccafc617b387aff7261c1116043e3, disabling compactions & flushes 2024-03-07 12:15:41,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:15:41,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:15:41,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. after waiting 0 ms 2024-03-07 12:15:41,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:15:41,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-07 12:15:41,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-07 12:15:41,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3. 2024-03-07 12:15:41,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 4bdccafc617b387aff7261c1116043e3: 2024-03-07 12:15:41,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700. 2024-03-07 12:15:41,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 52a45db6cec97f3e97fc5c53c0444700: 2024-03-07 12:15:41,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 4bdccafc617b387aff7261c1116043e3 2024-03-07 12:15:41,265 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=4bdccafc617b387aff7261c1116043e3, regionState=CLOSED 2024-03-07 12:15:41,266 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813741265"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813741265"}]},"ts":"1709813741265"} 2024-03-07 12:15:41,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.UnassignRegionHandler(149): Closed 52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:15:41,266 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=52a45db6cec97f3e97fc5c53c0444700, regionState=CLOSED 2024-03-07 12:15:41,266 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709813741266"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709813741266"}]},"ts":"1709813741266"} 2024-03-07 12:15:41,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-03-07 12:15:41,270 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure 4bdccafc617b387aff7261c1116043e3, server=jenkins-hbase16.apache.org,34997,1709813672259 in 164 msec 2024-03-07 12:15:41,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-03-07 12:15:41,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=4bdccafc617b387aff7261c1116043e3, UNASSIGN in 172 msec 2024-03-07 12:15:41,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure 52a45db6cec97f3e97fc5c53c0444700, server=jenkins-hbase16.apache.org,41591,1709813672309 in 166 msec 2024-03-07 12:15:41,273 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-03-07 12:15:41,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=52a45db6cec97f3e97fc5c53c0444700, UNASSIGN in 173 msec 2024-03-07 12:15:41,274 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709813741273"}]},"ts":"1709813741273"} 2024-03-07 12:15:41,275 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-03-07 12:15:41,285 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-03-07 12:15:41,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 209 msec 2024-03-07 12:15:41,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-07 12:15:41,334 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-03-07 12:15:41,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$5(2234): Client=jenkins//188.40.62.62 delete TestNs:TestTable 2024-03-07 12:15:41,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-03-07 12:15:41,339 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-07 12:15:41,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-07 12:15:41,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-07 12:15:41,346 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:15:41,346 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3 2024-03-07 12:15:41,348 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700/cf, FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700/recovered.edits] 2024-03-07 12:15:41,348 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3/cf, FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3/recovered.edits] 2024-03-07 12:15:41,356 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3/recovered.edits/4.seqid to hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/archive/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3/recovered.edits/4.seqid 2024-03-07 12:15:41,356 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700/recovered.edits/4.seqid to hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/archive/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700/recovered.edits/4.seqid 2024-03-07 12:15:41,358 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/4bdccafc617b387aff7261c1116043e3 2024-03-07 12:15:41,358 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/.tmp/data/TestNs/TestTable/52a45db6cec97f3e97fc5c53c0444700 2024-03-07 12:15:41,358 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-07 12:15:41,362 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-07 12:15:41,365 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-03-07 12:15:41,367 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-03-07 12:15:41,369 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-07 12:15:41,369 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-03-07 12:15:41,369 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709813741369"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:41,369 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709813741369"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:41,372 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-03-07 12:15:41,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 52a45db6cec97f3e97fc5c53c0444700, NAME => 'TestNs:TestTable,,1709813678733.52a45db6cec97f3e97fc5c53c0444700.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4bdccafc617b387aff7261c1116043e3, NAME => 'TestNs:TestTable,1,1709813678733.4bdccafc617b387aff7261c1116043e3.', STARTKEY => '1', ENDKEY => ''}] 2024-03-07 12:15:41,372 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-03-07 12:15:41,372 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709813741372"}]},"ts":"9223372036854775807"} 2024-03-07 12:15:41,374 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-03-07 12:15:41,387 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-07 12:15:41,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 52 msec 2024-03-07 12:15:41,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-07 12:15:41,593 INFO [Listener at localhost/44719] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-03-07 12:15:41,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.HMaster$17(3092): Client=jenkins//188.40.62.62 delete TestNs 2024-03-07 12:15:41,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-03-07 12:15:41,606 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-07 12:15:41,609 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-07 12:15:41,612 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-07 12:15:41,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-07 12:15:41,621 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-03-07 12:15:41,621 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-07 12:15:41,623 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-07 12:15:41,625 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-07 12:15:41,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 27 msec 2024-03-07 12:15:41,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37039] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-07 12:15:41,865 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-03-07 12:15:41,866 INFO [Listener at localhost/44719] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-07 12:15:41,866 DEBUG [Listener at localhost/44719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7486e015 to 127.0.0.1:54158 2024-03-07 12:15:41,866 DEBUG [Listener at localhost/44719] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-07 12:15:41,866 DEBUG [Listener at localhost/44719] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-03-07 12:15:41,867 DEBUG [Listener at localhost/44719] util.JVMClusterUtil(257): Found active master hash=73079740, stopped=false 2024-03-07 12:15:41,867 DEBUG [Listener at localhost/44719] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-07 12:15:41,867 INFO [Listener at localhost/44719] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:15:41,877 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-07 12:15:41,877 INFO [Listener at localhost/44719] procedure2.ProcedureExecutor(675): Stopping 2024-03-07 12:15:41,877 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-07 12:15:41,877 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-07 12:15:41,878 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:15:41,878 DEBUG [Listener at localhost/44719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x661d37e7 to 127.0.0.1:54158 2024-03-07 12:15:41,878 DEBUG [Listener at localhost/44719] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-07 12:15:41,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-07 12:15:41,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-07 12:15:41,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-07 12:15:41,878 INFO [Listener at localhost/44719] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase16.apache.org,34997,1709813672259' ***** 2024-03-07 12:15:41,879 INFO [Listener at localhost/44719] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-07 12:15:41,879 INFO [Listener at localhost/44719] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase16.apache.org,41591,1709813672309' ***** 2024-03-07 12:15:41,879 INFO [Listener at localhost/44719] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-07 12:15:41,879 INFO [RS:0;jenkins-hbase16:34997] regionserver.HeapMemoryManager(220): Stopping 2024-03-07 12:15:41,879 INFO [RS:1;jenkins-hbase16:41591] regionserver.HeapMemoryManager(220): Stopping 2024-03-07 12:15:41,879 INFO [RS:1;jenkins-hbase16:41591] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-07 12:15:41,879 INFO [RS:0;jenkins-hbase16:34997] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-07 12:15:41,879 INFO [RS:1;jenkins-hbase16:41591] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-07 12:15:41,879 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-07 12:15:41,879 INFO [RS:0;jenkins-hbase16:34997] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-07 12:15:41,879 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-07 12:15:41,879 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(3307): Received CLOSE for e526d9252721d81227d41279ca497aa0 2024-03-07 12:15:41,879 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(3307): Received CLOSE for 7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:15:41,880 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1147): stopping server jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:15:41,880 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1147): stopping server jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:41,880 INFO [RS:0;jenkins-hbase16:34997] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-07 12:15:41,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing e526d9252721d81227d41279ca497aa0, disabling compactions & flushes 2024-03-07 12:15:41,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 7af7cbf8b716e08a8d591b578a21be05, disabling compactions & flushes 2024-03-07 12:15:41,880 INFO [RS:1;jenkins-hbase16:41591] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-07 12:15:41,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:15:41,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:15:41,880 DEBUG [RS:0;jenkins-hbase16:34997] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61f80d33 to 127.0.0.1:54158 2024-03-07 12:15:41,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:15:41,881 DEBUG [RS:1;jenkins-hbase16:41591] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ab16865 to 127.0.0.1:54158 2024-03-07 12:15:41,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:15:41,881 DEBUG [RS:1;jenkins-hbase16:41591] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-07 12:15:41,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. after waiting 0 ms 2024-03-07 12:15:41,881 DEBUG [RS:0;jenkins-hbase16:34997] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-07 12:15:41,882 INFO [RS:1;jenkins-hbase16:41591] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-07 12:15:41,882 INFO [RS:1;jenkins-hbase16:41591] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-07 12:15:41,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:15:41,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. after waiting 0 ms 2024-03-07 12:15:41,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing e526d9252721d81227d41279ca497aa0 1/1 column families, dataSize=147 B heapSize=704 B 2024-03-07 12:15:41,882 INFO [RS:1;jenkins-hbase16:41591] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-07 12:15:41,882 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-03-07 12:15:41,882 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-03-07 12:15:41,883 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1481): Online Regions={e526d9252721d81227d41279ca497aa0=hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0.} 2024-03-07 12:15:41,882 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-03-07 12:15:41,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:15:41,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 7af7cbf8b716e08a8d591b578a21be05 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-03-07 12:15:41,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-07 12:15:41,883 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1481): Online Regions={7af7cbf8b716e08a8d591b578a21be05=hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05., 1588230740=hbase:meta,,1.1588230740} 2024-03-07 12:15:41,883 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-07 12:15:41,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-07 12:15:41,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-07 12:15:41,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-07 12:15:41,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.17 KB heapSize=25.12 KB 2024-03-07 12:15:41,884 DEBUG [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1507): Waiting on e526d9252721d81227d41279ca497aa0 2024-03-07 12:15:41,885 DEBUG [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1507): Waiting on 1588230740, 7af7cbf8b716e08a8d591b578a21be05 2024-03-07 12:15:41,933 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-07 12:15:41,933 INFO [regionserver/jenkins-hbase16:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-07 12:15:41,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/.tmp/q/e2df5b8dc93e432c9722f446e8583213 2024-03-07 12:15:41,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0/.tmp/info/b7ea37dff0b140c295d739b81139299f 2024-03-07 12:15:41,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.18 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/.tmp/info/74a0d7cfc93a43a6913c354089d01029 2024-03-07 12:15:41,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7ea37dff0b140c295d739b81139299f 2024-03-07 12:15:41,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2df5b8dc93e432c9722f446e8583213 2024-03-07 12:15:41,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0/.tmp/info/b7ea37dff0b140c295d739b81139299f as hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0/info/b7ea37dff0b140c295d739b81139299f 2024-03-07 12:15:41,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74a0d7cfc93a43a6913c354089d01029 2024-03-07 12:15:41,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7ea37dff0b140c295d739b81139299f 2024-03-07 12:15:41,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0/info/b7ea37dff0b140c295d739b81139299f, entries=3, sequenceid=8, filesize=5.0 K 2024-03-07 12:15:41,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for e526d9252721d81227d41279ca497aa0 in 82ms, sequenceid=8, compaction requested=false 2024-03-07 12:15:41,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/.tmp/u/caa12ffd056b4cbbab43c8db18679dde 2024-03-07 12:15:41,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/.tmp/rep_barrier/df632197e433474faed66ef85f8c4113 2024-03-07 12:15:41,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/namespace/e526d9252721d81227d41279ca497aa0/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-03-07 12:15:41,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for caa12ffd056b4cbbab43c8db18679dde 2024-03-07 12:15:41,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:15:41,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for e526d9252721d81227d41279ca497aa0: 2024-03-07 12:15:41,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1709813674368.e526d9252721d81227d41279ca497aa0. 2024-03-07 12:15:41,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/.tmp/q/e2df5b8dc93e432c9722f446e8583213 as hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/q/e2df5b8dc93e432c9722f446e8583213 2024-03-07 12:15:41,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df632197e433474faed66ef85f8c4113 2024-03-07 12:15:41,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2df5b8dc93e432c9722f446e8583213 2024-03-07 12:15:41,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/q/e2df5b8dc93e432c9722f446e8583213, entries=5, sequenceid=17, filesize=5.1 K 2024-03-07 12:15:41,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/.tmp/u/caa12ffd056b4cbbab43c8db18679dde as hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/u/caa12ffd056b4cbbab43c8db18679dde 2024-03-07 12:15:42,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/.tmp/table/6fbd79650ba74874b1fef971c38fabef 2024-03-07 12:15:42,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for caa12ffd056b4cbbab43c8db18679dde 2024-03-07 12:15:42,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/u/caa12ffd056b4cbbab43c8db18679dde, entries=4, sequenceid=17, filesize=5.0 K 2024-03-07 12:15:42,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 7af7cbf8b716e08a8d591b578a21be05 in 124ms, sequenceid=17, compaction requested=false 2024-03-07 12:15:42,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/quota/7af7cbf8b716e08a8d591b578a21be05/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-03-07 12:15:42,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fbd79650ba74874b1fef971c38fabef 2024-03-07 12:15:42,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:15:42,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 7af7cbf8b716e08a8d591b578a21be05: 2024-03-07 12:15:42,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1709813675486.7af7cbf8b716e08a8d591b578a21be05. 2024-03-07 12:15:42,017 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/.tmp/info/74a0d7cfc93a43a6913c354089d01029 as hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/info/74a0d7cfc93a43a6913c354089d01029 2024-03-07 12:15:42,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74a0d7cfc93a43a6913c354089d01029 2024-03-07 12:15:42,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/info/74a0d7cfc93a43a6913c354089d01029, entries=30, sequenceid=66, filesize=8.0 K 2024-03-07 12:15:42,028 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/.tmp/rep_barrier/df632197e433474faed66ef85f8c4113 as hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/rep_barrier/df632197e433474faed66ef85f8c4113 2024-03-07 12:15:42,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df632197e433474faed66ef85f8c4113 2024-03-07 12:15:42,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/rep_barrier/df632197e433474faed66ef85f8c4113, entries=5, sequenceid=66, filesize=5.3 K 2024-03-07 12:15:42,038 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/.tmp/table/6fbd79650ba74874b1fef971c38fabef as hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/table/6fbd79650ba74874b1fef971c38fabef 2024-03-07 12:15:42,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fbd79650ba74874b1fef971c38fabef 2024-03-07 12:15:42,047 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HStore(1080): Added hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/table/6fbd79650ba74874b1fef971c38fabef, entries=13, sequenceid=66, filesize=5.6 K 2024-03-07 12:15:42,048 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.17 KB/14513, heapSize ~25.07 KB/25672, currentSize=0 B/0 for 1588230740 in 164ms, sequenceid=66, compaction requested=false 2024-03-07 12:15:42,057 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-03-07 12:15:42,058 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-07 12:15:42,058 INFO [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-07 12:15:42,059 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-07 12:15:42,059 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase16:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-03-07 12:15:42,085 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1173): stopping server jenkins-hbase16.apache.org,34997,1709813672259; all regions closed. 2024-03-07 12:15:42,085 DEBUG [RS:0;jenkins-hbase16:34997] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-07 12:15:42,085 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1173): stopping server jenkins-hbase16.apache.org,41591,1709813672309; all regions closed. 2024-03-07 12:15:42,085 DEBUG [RS:1;jenkins-hbase16:41591] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-07 12:15:42,098 DEBUG [RS:1;jenkins-hbase16:41591] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/oldWALs 2024-03-07 12:15:42,098 INFO [RS:1;jenkins-hbase16:41591] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C41591%2C1709813672309.meta:.meta(num 1709813674074) 2024-03-07 12:15:42,104 DEBUG [RS:0;jenkins-hbase16:34997] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/oldWALs 2024-03-07 12:15:42,104 INFO [RS:0;jenkins-hbase16:34997] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C34997%2C1709813672259:(num 1709813673937) 2024-03-07 12:15:42,104 DEBUG [RS:0;jenkins-hbase16:34997] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-07 12:15:42,105 INFO [RS:0;jenkins-hbase16:34997] regionserver.LeaseManager(133): Closed leases 2024-03-07 12:15:42,105 INFO [RS:0;jenkins-hbase16:34997] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-03-07 12:15:42,105 INFO [RS:0;jenkins-hbase16:34997] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-07 12:15:42,105 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-07 12:15:42,105 INFO [RS:0;jenkins-hbase16:34997] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-07 12:15:42,105 INFO [RS:0;jenkins-hbase16:34997] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-07 12:15:42,106 INFO [RS:0;jenkins-hbase16:34997] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:34997 2024-03-07 12:15:42,108 DEBUG [RS:1;jenkins-hbase16:41591] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/oldWALs 2024-03-07 12:15:42,108 INFO [RS:1;jenkins-hbase16:41591] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase16.apache.org%2C41591%2C1709813672309:(num 1709813673938) 2024-03-07 12:15:42,108 DEBUG [RS:1;jenkins-hbase16:41591] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-07 12:15:42,108 INFO [RS:1;jenkins-hbase16:41591] regionserver.LeaseManager(133): Closed leases 2024-03-07 12:15:42,108 INFO [RS:1;jenkins-hbase16:41591] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase16:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-03-07 12:15:42,109 INFO [regionserver/jenkins-hbase16:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-07 12:15:42,109 INFO [RS:1;jenkins-hbase16:41591] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:41591 2024-03-07 12:15:42,122 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-07 12:15:42,122 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:15:42,122 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-07 12:15:42,122 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,34997,1709813672259 2024-03-07 12:15:42,122 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-07 12:15:42,122 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:42,122 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase16.apache.org,41591,1709813672309 2024-03-07 12:15:42,130 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,34997,1709813672259] 2024-03-07 12:15:42,130 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,34997,1709813672259; numProcessing=1 2024-03-07 12:15:42,138 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,34997,1709813672259 already deleted, retry=false 2024-03-07 12:15:42,138 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase16.apache.org,34997,1709813672259 expired; onlineServers=1 2024-03-07 12:15:42,138 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase16.apache.org,41591,1709813672309] 2024-03-07 12:15:42,138 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase16.apache.org,41591,1709813672309; numProcessing=2 2024-03-07 12:15:42,146 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase16.apache.org,41591,1709813672309 already deleted, retry=false 2024-03-07 12:15:42,146 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase16.apache.org,41591,1709813672309 expired; onlineServers=0 2024-03-07 12:15:42,146 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase16.apache.org,37039,1709813671023' ***** 2024-03-07 12:15:42,146 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-03-07 12:15:42,147 DEBUG [M:0;jenkins-hbase16:37039] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28332db8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase16.apache.org/188.40.62.62:0 2024-03-07 12:15:42,148 INFO [M:0;jenkins-hbase16:37039] regionserver.HRegionServer(1147): stopping server jenkins-hbase16.apache.org,37039,1709813671023 2024-03-07 12:15:42,148 INFO [M:0;jenkins-hbase16:37039] regionserver.HRegionServer(1173): stopping server jenkins-hbase16.apache.org,37039,1709813671023; all regions closed. 2024-03-07 12:15:42,148 DEBUG [M:0;jenkins-hbase16:37039] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-07 12:15:42,148 DEBUG [M:0;jenkins-hbase16:37039] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-03-07 12:15:42,148 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-03-07 12:15:42,148 DEBUG [M:0;jenkins-hbase16:37039] cleaner.HFileCleaner(317): Stopping file delete threads 2024-03-07 12:15:42,148 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1709813673531] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.small.0-1709813673531,5,FailOnTimeoutGroup] 2024-03-07 12:15:42,148 INFO [M:0;jenkins-hbase16:37039] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-03-07 12:15:42,148 DEBUG [master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1709813673531] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase16:0:becomeActiveMaster-HFileCleaner.large.0-1709813673531,5,FailOnTimeoutGroup] 2024-03-07 12:15:42,149 INFO [M:0;jenkins-hbase16:37039] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-03-07 12:15:42,149 INFO [M:0;jenkins-hbase16:37039] hbase.ChoreService(369): Chore service for: master/jenkins-hbase16:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-03-07 12:15:42,149 DEBUG [M:0;jenkins-hbase16:37039] master.HMaster(1517): Stopping service threads 2024-03-07 12:15:42,149 INFO [M:0;jenkins-hbase16:37039] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-03-07 12:15:42,149 ERROR [M:0;jenkins-hbase16:37039] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-03-07 12:15:42,150 INFO [M:0;jenkins-hbase16:37039] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-03-07 12:15:42,150 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-03-07 12:15:42,155 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-03-07 12:15:42,155 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-07 12:15:42,155 DEBUG [M:0;jenkins-hbase16:37039] zookeeper.ZKUtil(399): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-03-07 12:15:42,155 WARN [M:0;jenkins-hbase16:37039] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-03-07 12:15:42,155 INFO [M:0;jenkins-hbase16:37039] assignment.AssignmentManager(315): Stopping assignment manager 2024-03-07 12:15:42,155 INFO [M:0;jenkins-hbase16:37039] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-03-07 12:15:42,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-07 12:15:42,156 DEBUG [M:0;jenkins-hbase16:37039] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-07 12:15:42,156 INFO [M:0;jenkins-hbase16:37039] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-07 12:15:42,156 DEBUG [M:0;jenkins-hbase16:37039] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-07 12:15:42,156 DEBUG [M:0;jenkins-hbase16:37039] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-07 12:15:42,156 DEBUG [M:0;jenkins-hbase16:37039] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-07 12:15:42,156 INFO [M:0;jenkins-hbase16:37039] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.21 KB heapSize=185 KB 2024-03-07 12:15:42,175 INFO [M:0;jenkins-hbase16:37039] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.21 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b97623931b1f4803a339a91d46d42b08 2024-03-07 12:15:42,181 INFO [M:0;jenkins-hbase16:37039] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b97623931b1f4803a339a91d46d42b08 2024-03-07 12:15:42,183 DEBUG [M:0;jenkins-hbase16:37039] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b97623931b1f4803a339a91d46d42b08 as hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b97623931b1f4803a339a91d46d42b08 2024-03-07 12:15:42,190 INFO [M:0;jenkins-hbase16:37039] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b97623931b1f4803a339a91d46d42b08 2024-03-07 12:15:42,191 INFO [M:0;jenkins-hbase16:37039] regionserver.HStore(1080): Added hdfs://localhost:39713/user/jenkins/test-data/5531c6b5-d156-ef2a-e8d6-baf6079fcb28/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b97623931b1f4803a339a91d46d42b08, entries=45, sequenceid=376, filesize=12.0 K 2024-03-07 12:15:42,192 INFO [M:0;jenkins-hbase16:37039] regionserver.HRegion(2948): Finished flush of dataSize ~153.21 KB/156892, heapSize ~184.98 KB/189424, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 36ms, sequenceid=376, compaction requested=false 2024-03-07 12:15:42,193 INFO [M:0;jenkins-hbase16:37039] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-07 12:15:42,193 DEBUG [M:0;jenkins-hbase16:37039] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-07 12:15:42,198 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-07 12:15:42,198 INFO [M:0;jenkins-hbase16:37039] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-03-07 12:15:42,198 INFO [M:0;jenkins-hbase16:37039] ipc.NettyRpcServer(158): Stopping server on /188.40.62.62:37039 2024-03-07 12:15:42,230 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-07 12:15:42,230 INFO [RS:1;jenkins-hbase16:41591] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase16.apache.org,41591,1709813672309; zookeeper connection closed. 2024-03-07 12:15:42,230 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:34997-0x1003cecce640001, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-07 12:15:42,230 INFO [RS:0;jenkins-hbase16:34997] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase16.apache.org,34997,1709813672259; zookeeper connection closed. 2024-03-07 12:15:42,230 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-07 12:15:42,230 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): regionserver:41591-0x1003cecce640002, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-07 12:15:42,230 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@61bec8e3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@61bec8e3 2024-03-07 12:15:42,230 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42a95db4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42a95db4 2024-03-07 12:15:42,231 INFO [Listener at localhost/44719] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-03-07 12:15:42,334 DEBUG [M:0;jenkins-hbase16:37039] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase16.apache.org,37039,1709813671023 already deleted, retry=false 2024-03-07 12:15:42,455 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-07 12:15:42,455 INFO [M:0;jenkins-hbase16:37039] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase16.apache.org,37039,1709813671023; zookeeper connection closed. 2024-03-07 12:15:42,455 DEBUG [Listener at localhost/44719-EventThread] zookeeper.ZKWatcher(600): master:37039-0x1003cecce640000, quorum=127.0.0.1:54158, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-07 12:15:42,457 WARN [Listener at localhost/44719] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-07 12:15:42,459 INFO [Listener at localhost/44719] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-07 12:15:42,563 WARN [BP-1476426901-188.40.62.62-1709813667177 heartbeating to localhost/127.0.0.1:39713] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-07 12:15:42,563 WARN [BP-1476426901-188.40.62.62-1709813667177 heartbeating to localhost/127.0.0.1:39713] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1476426901-188.40.62.62-1709813667177 (Datanode Uuid d484c01d-b772-4695-962f-4d23983cde7e) service to localhost/127.0.0.1:39713 2024-03-07 12:15:42,565 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/cluster_c91cfe98-0fce-3cda-638f-d6df315f0224/dfs/data/data3/current/BP-1476426901-188.40.62.62-1709813667177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-07 12:15:42,565 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/cluster_c91cfe98-0fce-3cda-638f-d6df315f0224/dfs/data/data4/current/BP-1476426901-188.40.62.62-1709813667177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-07 12:15:42,567 WARN [Listener at localhost/44719] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-07 12:15:42,570 INFO [Listener at localhost/44719] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-07 12:15:42,673 WARN [BP-1476426901-188.40.62.62-1709813667177 heartbeating to localhost/127.0.0.1:39713] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-07 12:15:42,674 WARN [BP-1476426901-188.40.62.62-1709813667177 heartbeating to localhost/127.0.0.1:39713] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1476426901-188.40.62.62-1709813667177 (Datanode Uuid 5e7d11c3-2a58-4900-af66-8052aaa38c0e) service to localhost/127.0.0.1:39713 2024-03-07 12:15:42,674 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/cluster_c91cfe98-0fce-3cda-638f-d6df315f0224/dfs/data/data1/current/BP-1476426901-188.40.62.62-1709813667177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-07 12:15:42,675 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/63e4dec8-5285-e4b7-6e5c-38eb9006675e/cluster_c91cfe98-0fce-3cda-638f-d6df315f0224/dfs/data/data2/current/BP-1476426901-188.40.62.62-1709813667177] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-07 12:15:42,710 INFO [Listener at localhost/44719] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-07 12:15:42,823 INFO [Listener at localhost/44719] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-03-07 12:15:42,863 INFO [Listener at localhost/44719] hbase.HBaseTestingUtility(1293): Minicluster is down