2024-01-05 21:52:42,378 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-01-05 21:52:42,593 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1 2024-01-05 21:52:42,607 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-01-05 21:52:42,607 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/cluster_c41249bd-57d3-bc63-2b71-16992bb6765d, deleteOnExit=true 2024-01-05 21:52:42,607 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-01-05 21:52:42,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/test.cache.data in system properties and HBase conf 2024-01-05 21:52:42,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/hadoop.tmp.dir in system properties and HBase conf 2024-01-05 21:52:42,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/hadoop.log.dir in system properties and HBase conf 2024-01-05 21:52:42,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/mapreduce.cluster.local.dir in system properties and HBase conf 2024-01-05 21:52:42,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-01-05 21:52:42,609 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-01-05 21:52:42,717 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-01-05 21:52:43,100 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-05 21:52:43,104 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-01-05 21:52:43,104 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-01-05 21:52:43,105 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-01-05 21:52:43,105 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-05 21:52:43,105 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-01-05 21:52:43,106 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-01-05 21:52:43,106 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-05 21:52:43,106 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-05 21:52:43,107 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-01-05 21:52:43,107 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/nfs.dump.dir in system properties and HBase conf 2024-01-05 21:52:43,108 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/java.io.tmpdir in system properties and HBase conf 2024-01-05 21:52:43,108 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-05 21:52:43,108 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-01-05 21:52:43,109 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-01-05 21:52:43,607 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-05 21:52:43,611 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-05 21:52:43,845 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-01-05 21:52:44,005 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-01-05 21:52:44,028 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-05 21:52:44,063 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-01-05 21:52:44,090 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/java.io.tmpdir/Jetty_localhost_40071_hdfs____.835cg8/webapp 2024-01-05 21:52:44,201 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40071 2024-01-05 21:52:44,209 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-05 21:52:44,210 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-05 21:52:44,579 WARN [Listener at localhost/39451] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-05 21:52:44,637 WARN [Listener at localhost/39451] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-05 21:52:44,651 WARN [Listener at localhost/39451] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-05 21:52:44,656 INFO [Listener at localhost/39451] log.Slf4jLog(67): jetty-6.1.26 2024-01-05 21:52:44,660 INFO [Listener at localhost/39451] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/java.io.tmpdir/Jetty_localhost_44385_datanode____y1kwk7/webapp 2024-01-05 21:52:44,738 INFO [Listener at localhost/39451] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44385 2024-01-05 21:52:45,006 WARN [Listener at localhost/40955] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-05 21:52:45,015 WARN [Listener at localhost/40955] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-05 21:52:45,022 WARN [Listener at localhost/40955] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-05 21:52:45,023 INFO [Listener at localhost/40955] log.Slf4jLog(67): jetty-6.1.26 2024-01-05 21:52:45,029 INFO [Listener at localhost/40955] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/java.io.tmpdir/Jetty_localhost_40681_datanode____jylnh6/webapp 2024-01-05 21:52:45,109 INFO [Listener at localhost/40955] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40681 2024-01-05 21:52:45,118 WARN [Listener at localhost/39519] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-05 21:52:45,383 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd176b9a4aa8b3327: Processing first storage report for DS-983a7978-0e4f-430e-bbe7-f099e58e0aae from datanode 9c772e53-b820-4458-8e8a-a0a227630c06 2024-01-05 21:52:45,385 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd176b9a4aa8b3327: from storage DS-983a7978-0e4f-430e-bbe7-f099e58e0aae node DatanodeRegistration(127.0.0.1:38801, datanodeUuid=9c772e53-b820-4458-8e8a-a0a227630c06, infoPort=38755, infoSecurePort=0, ipcPort=39519, storageInfo=lv=-57;cid=testClusterID;nsid=509501951;c=1704491563680), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-01-05 21:52:45,385 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x808e0de36546ecb5: Processing first storage report for DS-e766f585-6112-44a0-9d0f-eeb0e7206da6 from datanode 22d69153-d95a-48c4-86bf-ef1072c24866 2024-01-05 21:52:45,385 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x808e0de36546ecb5: from storage DS-e766f585-6112-44a0-9d0f-eeb0e7206da6 node DatanodeRegistration(127.0.0.1:39771, datanodeUuid=22d69153-d95a-48c4-86bf-ef1072c24866, infoPort=33505, infoSecurePort=0, ipcPort=40955, storageInfo=lv=-57;cid=testClusterID;nsid=509501951;c=1704491563680), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-05 21:52:45,385 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd176b9a4aa8b3327: Processing first storage report for DS-aba91636-79d1-4833-873f-e1c08f26c7e8 from datanode 9c772e53-b820-4458-8e8a-a0a227630c06 2024-01-05 21:52:45,385 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd176b9a4aa8b3327: from storage DS-aba91636-79d1-4833-873f-e1c08f26c7e8 node DatanodeRegistration(127.0.0.1:38801, datanodeUuid=9c772e53-b820-4458-8e8a-a0a227630c06, infoPort=38755, infoSecurePort=0, ipcPort=39519, storageInfo=lv=-57;cid=testClusterID;nsid=509501951;c=1704491563680), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-05 21:52:45,385 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x808e0de36546ecb5: Processing first storage report for DS-e5d972fa-303c-4e3a-a1c7-88a2495fbde7 from datanode 22d69153-d95a-48c4-86bf-ef1072c24866 2024-01-05 21:52:45,386 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x808e0de36546ecb5: from storage DS-e5d972fa-303c-4e3a-a1c7-88a2495fbde7 node DatanodeRegistration(127.0.0.1:39771, datanodeUuid=22d69153-d95a-48c4-86bf-ef1072c24866, infoPort=33505, infoSecurePort=0, ipcPort=40955, storageInfo=lv=-57;cid=testClusterID;nsid=509501951;c=1704491563680), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-05 21:52:45,457 DEBUG [Listener at localhost/39519] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1 2024-01-05 21:52:45,552 INFO [Listener at localhost/39519] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/cluster_c41249bd-57d3-bc63-2b71-16992bb6765d/zookeeper_0, clientPort=61550, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/cluster_c41249bd-57d3-bc63-2b71-16992bb6765d/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/cluster_c41249bd-57d3-bc63-2b71-16992bb6765d/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-01-05 21:52:45,574 INFO [Listener at localhost/39519] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61550 2024-01-05 21:52:45,586 INFO [Listener at localhost/39519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:45,589 INFO [Listener at localhost/39519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:46,196 INFO [Listener at localhost/39519] util.FSUtils(471): Created version file at hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9 with version=8 2024-01-05 21:52:46,196 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/hbase-staging 2024-01-05 21:52:46,432 INFO [Listener at localhost/39519] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-01-05 21:52:46,816 INFO [Listener at localhost/39519] client.ConnectionUtils(126): master/jenkins-hbase17:0 server-side Connection retries=45 2024-01-05 21:52:46,843 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:46,844 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:46,844 INFO [Listener at localhost/39519] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-05 21:52:46,844 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:46,844 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-05 21:52:46,992 INFO [Listener at localhost/39519] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-01-05 21:52:47,067 DEBUG [Listener at localhost/39519] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-01-05 21:52:47,166 INFO [Listener at localhost/39519] ipc.NettyRpcServer(120): Bind to /136.243.18.41:43675 2024-01-05 21:52:47,179 INFO [Listener at localhost/39519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:47,182 INFO [Listener at localhost/39519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:47,212 INFO [Listener at localhost/39519] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43675 connecting to ZooKeeper ensemble=127.0.0.1:61550 2024-01-05 21:52:47,245 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:436750x0, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-05 21:52:47,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43675-0x100f99064610000 connected 2024-01-05 21:52:47,280 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-05 21:52:47,281 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-05 21:52:47,285 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-05 21:52:47,293 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43675 2024-01-05 21:52:47,294 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43675 2024-01-05 21:52:47,297 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43675 2024-01-05 21:52:47,298 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43675 2024-01-05 21:52:47,298 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43675 2024-01-05 21:52:47,303 INFO [Listener at localhost/39519] master.HMaster(445): hbase.rootdir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9, hbase.cluster.distributed=false 2024-01-05 21:52:47,364 INFO [Listener at localhost/39519] client.ConnectionUtils(126): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2024-01-05 21:52:47,364 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:47,364 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:47,364 INFO [Listener at localhost/39519] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-05 21:52:47,364 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:47,364 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-05 21:52:47,369 INFO [Listener at localhost/39519] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-05 21:52:47,372 INFO [Listener at localhost/39519] ipc.NettyRpcServer(120): Bind to /136.243.18.41:40573 2024-01-05 21:52:47,374 INFO [Listener at localhost/39519] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-05 21:52:47,379 DEBUG [Listener at localhost/39519] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-05 21:52:47,381 INFO [Listener at localhost/39519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:47,383 INFO [Listener at localhost/39519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:47,385 INFO [Listener at localhost/39519] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40573 connecting to ZooKeeper ensemble=127.0.0.1:61550 2024-01-05 21:52:47,545 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:405730x0, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-05 21:52:47,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40573-0x100f99064610001 connected 2024-01-05 21:52:47,547 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-05 21:52:47,548 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-05 21:52:47,550 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-05 21:52:47,550 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40573 2024-01-05 21:52:47,553 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40573 2024-01-05 21:52:47,553 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40573 2024-01-05 21:52:47,555 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40573 2024-01-05 21:52:47,555 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40573 2024-01-05 21:52:47,565 INFO [Listener at localhost/39519] client.ConnectionUtils(126): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2024-01-05 21:52:47,565 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:47,566 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:47,566 INFO [Listener at localhost/39519] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-05 21:52:47,566 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-05 21:52:47,566 INFO [Listener at localhost/39519] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-05 21:52:47,566 INFO [Listener at localhost/39519] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-05 21:52:47,568 INFO [Listener at localhost/39519] ipc.NettyRpcServer(120): Bind to /136.243.18.41:45377 2024-01-05 21:52:47,568 INFO [Listener at localhost/39519] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-05 21:52:47,569 DEBUG [Listener at localhost/39519] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-05 21:52:47,570 INFO [Listener at localhost/39519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:47,571 INFO [Listener at localhost/39519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:47,573 INFO [Listener at localhost/39519] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45377 connecting to ZooKeeper ensemble=127.0.0.1:61550 2024-01-05 21:52:47,884 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:453770x0, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-05 21:52:47,888 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): regionserver:453770x0, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-05 21:52:47,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45377-0x100f99064610002 connected 2024-01-05 21:52:47,890 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-05 21:52:47,891 DEBUG [Listener at localhost/39519] zookeeper.ZKUtil(165): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-05 21:52:47,893 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45377 2024-01-05 21:52:47,894 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45377 2024-01-05 21:52:47,894 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45377 2024-01-05 21:52:47,900 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45377 2024-01-05 21:52:47,900 DEBUG [Listener at localhost/39519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45377 2024-01-05 21:52:47,906 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:52:48,118 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-05 21:52:48,120 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:52:48,138 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-05 21:52:48,138 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-05 21:52:48,138 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-05 21:52:48,139 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:52:48,140 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-05 21:52:48,141 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,43675,1704491566307 from backup master directory 2024-01-05 21:52:48,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-05 21:52:48,144 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:52:48,144 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-05 21:52:48,145 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-05 21:52:48,145 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:52:48,147 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-01-05 21:52:48,148 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-01-05 21:52:48,225 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/hbase.id with ID: 9b5c7d50-25b7-48f3-9886-3ddbff0cd93e 2024-01-05 21:52:48,278 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-05 21:52:48,296 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:52:48,341 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3760bbc6 to 127.0.0.1:61550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-05 21:52:48,372 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fffd7ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-05 21:52:48,395 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-05 21:52:48,398 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-01-05 21:52:48,414 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-01-05 21:52:48,414 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-01-05 21:52:48,416 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-05 21:52:48,420 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-05 21:52:48,421 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-05 21:52:48,454 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store-tmp 2024-01-05 21:52:48,490 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:48,491 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-05 21:52:48,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-05 21:52:48,491 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-05 21:52:48,491 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-05 21:52:48,491 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-05 21:52:48,491 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-05 21:52:48,492 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-05 21:52:48,494 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/WALs/jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:52:48,518 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C43675%2C1704491566307, suffix=, logDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/WALs/jenkins-hbase17.apache.org,43675,1704491566307, archiveDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/oldWALs, maxLogs=10 2024-01-05 21:52:48,593 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39771,DS-e766f585-6112-44a0-9d0f-eeb0e7206da6,DISK] 2024-01-05 21:52:48,593 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38801,DS-983a7978-0e4f-430e-bbe7-f099e58e0aae,DISK] 2024-01-05 21:52:48,602 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-01-05 21:52:48,665 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/WALs/jenkins-hbase17.apache.org,43675,1704491566307/jenkins-hbase17.apache.org%2C43675%2C1704491566307.1704491568531 2024-01-05 21:52:48,665 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39771,DS-e766f585-6112-44a0-9d0f-eeb0e7206da6,DISK], DatanodeInfoWithStorage[127.0.0.1:38801,DS-983a7978-0e4f-430e-bbe7-f099e58e0aae,DISK]] 2024-01-05 21:52:48,666 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-01-05 21:52:48,666 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:48,670 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-01-05 21:52:48,672 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-01-05 21:52:48,737 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-01-05 21:52:48,746 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-01-05 21:52:48,770 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-01-05 21:52:48,781 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:48,788 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-05 21:52:48,790 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-05 21:52:48,810 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-01-05 21:52:48,816 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:48,818 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66080085, jitterRate=-0.015330001711845398}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-05 21:52:48,818 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-05 21:52:48,819 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-01-05 21:52:48,835 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-01-05 21:52:48,836 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-01-05 21:52:48,839 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-01-05 21:52:48,841 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-01-05 21:52:48,870 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 29 msec 2024-01-05 21:52:48,870 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-01-05 21:52:48,894 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-01-05 21:52:48,900 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-01-05 21:52:48,924 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-01-05 21:52:48,927 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-01-05 21:52:48,929 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-01-05 21:52:48,934 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-01-05 21:52:48,938 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-01-05 21:52:48,941 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:52:48,943 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-01-05 21:52:48,943 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-01-05 21:52:48,958 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-01-05 21:52:48,964 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-05 21:52:48,964 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-05 21:52:48,964 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-05 21:52:48,964 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:52:48,965 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase17.apache.org,43675,1704491566307, sessionid=0x100f99064610000, setting cluster-up flag (Was=false) 2024-01-05 21:52:48,978 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:52:48,983 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-01-05 21:52:48,985 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:52:48,989 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:52:48,994 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-01-05 21:52:48,996 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:52:48,998 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.hbase-snapshot/.tmp 2024-01-05 21:52:49,004 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(954): ClusterId : 9b5c7d50-25b7-48f3-9886-3ddbff0cd93e 2024-01-05 21:52:49,004 INFO [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(954): ClusterId : 9b5c7d50-25b7-48f3-9886-3ddbff0cd93e 2024-01-05 21:52:49,008 DEBUG [RS:0;jenkins-hbase17:40573] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-05 21:52:49,008 DEBUG [RS:1;jenkins-hbase17:45377] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-05 21:52:49,013 DEBUG [RS:0;jenkins-hbase17:40573] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-05 21:52:49,013 DEBUG [RS:0;jenkins-hbase17:40573] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-05 21:52:49,017 DEBUG [RS:0;jenkins-hbase17:40573] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-05 21:52:49,019 DEBUG [RS:1;jenkins-hbase17:45377] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-05 21:52:49,019 DEBUG [RS:0;jenkins-hbase17:40573] zookeeper.ReadOnlyZKClient(139): Connect 0x7768e20d to 127.0.0.1:61550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-05 21:52:49,020 DEBUG [RS:1;jenkins-hbase17:45377] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-05 21:52:49,024 DEBUG [RS:1;jenkins-hbase17:45377] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-05 21:52:49,027 DEBUG [RS:1;jenkins-hbase17:45377] zookeeper.ReadOnlyZKClient(139): Connect 0x217c86e1 to 127.0.0.1:61550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-05 21:52:49,027 DEBUG [RS:0;jenkins-hbase17:40573] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79af1290, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-05 21:52:49,028 DEBUG [RS:0;jenkins-hbase17:40573] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d90897d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2024-01-05 21:52:49,042 DEBUG [RS:1;jenkins-hbase17:45377] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fbb6cbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-05 21:52:49,042 DEBUG [RS:1;jenkins-hbase17:45377] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b84ed91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2024-01-05 21:52:49,053 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-01-05 21:52:49,058 DEBUG [RS:1;jenkins-hbase17:45377] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:45377 2024-01-05 21:52:49,058 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:40573 2024-01-05 21:52:49,063 INFO [RS:1;jenkins-hbase17:45377] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-05 21:52:49,063 INFO [RS:0;jenkins-hbase17:40573] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-05 21:52:49,064 INFO [RS:0;jenkins-hbase17:40573] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-05 21:52:49,064 INFO [RS:1;jenkins-hbase17:45377] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-05 21:52:49,064 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1025): About to register with Master. 2024-01-05 21:52:49,064 DEBUG [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1025): About to register with Master. 2024-01-05 21:52:49,067 INFO [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase17.apache.org,43675,1704491566307 with isa=jenkins-hbase17.apache.org/136.243.18.41:45377, startcode=1704491567565 2024-01-05 21:52:49,067 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase17.apache.org,43675,1704491566307 with isa=jenkins-hbase17.apache.org/136.243.18.41:40573, startcode=1704491567363 2024-01-05 21:52:49,089 DEBUG [RS:1;jenkins-hbase17:45377] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-05 21:52:49,089 DEBUG [RS:0;jenkins-hbase17:40573] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-05 21:52:49,184 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-01-05 21:52:49,199 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57357, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-01-05 21:52:49,199 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44013, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-01-05 21:52:49,202 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2024-01-05 21:52:49,202 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2024-01-05 21:52:49,203 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2024-01-05 21:52:49,203 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2024-01-05 21:52:49,203 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2024-01-05 21:52:49,203 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,203 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2024-01-05 21:52:49,203 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,212 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1704491599212 2024-01-05 21:52:49,216 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-01-05 21:52:49,216 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43675] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-01-05 21:52:49,219 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-01-05 21:52:49,220 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-01-05 21:52:49,234 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43675] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-01-05 21:52:49,237 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-01-05 21:52:49,238 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-05 21:52:49,246 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-01-05 21:52:49,247 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-01-05 21:52:49,247 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-01-05 21:52:49,248 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-01-05 21:52:49,252 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,257 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-01-05 21:52:49,259 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-01-05 21:52:49,260 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-01-05 21:52:49,262 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-01-05 21:52:49,263 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-01-05 21:52:49,264 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(2833): Master is not running yet 2024-01-05 21:52:49,264 DEBUG [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(2833): Master is not running yet 2024-01-05 21:52:49,264 WARN [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-01-05 21:52:49,264 WARN [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-01-05 21:52:49,265 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1704491569265,5,FailOnTimeoutGroup] 2024-01-05 21:52:49,269 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1704491569266,5,FailOnTimeoutGroup] 2024-01-05 21:52:49,269 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,269 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-01-05 21:52:49,271 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,271 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,297 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-05 21:52:49,298 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-05 21:52:49,298 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9 2024-01-05 21:52:49,322 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:49,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-05 21:52:49,332 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/info 2024-01-05 21:52:49,333 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-05 21:52:49,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:49,335 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-05 21:52:49,338 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/rep_barrier 2024-01-05 21:52:49,339 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-05 21:52:49,340 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:49,341 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-05 21:52:49,343 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/table 2024-01-05 21:52:49,344 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-05 21:52:49,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:49,347 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740 2024-01-05 21:52:49,348 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740 2024-01-05 21:52:49,351 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-05 21:52:49,354 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-05 21:52:49,357 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:49,359 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73720838, jitterRate=0.09852609038352966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-05 21:52:49,359 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-05 21:52:49,359 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-05 21:52:49,359 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-05 21:52:49,360 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-05 21:52:49,360 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-05 21:52:49,360 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-05 21:52:49,361 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-05 21:52:49,361 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-05 21:52:49,366 INFO [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase17.apache.org,43675,1704491566307 with isa=jenkins-hbase17.apache.org/136.243.18.41:45377, startcode=1704491567565 2024-01-05 21:52:49,366 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase17.apache.org,43675,1704491566307 with isa=jenkins-hbase17.apache.org/136.243.18.41:40573, startcode=1704491567363 2024-01-05 21:52:49,369 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-01-05 21:52:49,369 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-01-05 21:52:49,373 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43675] master.ServerManager(388): Registering regionserver=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:49,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-01-05 21:52:49,378 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43675] master.ServerManager(388): Registering regionserver=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:49,379 DEBUG [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9 2024-01-05 21:52:49,379 DEBUG [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:39451 2024-01-05 21:52:49,379 DEBUG [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-05 21:52:49,380 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9 2024-01-05 21:52:49,380 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:39451 2024-01-05 21:52:49,380 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-05 21:52:49,386 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-05 21:52:49,387 DEBUG [RS:1;jenkins-hbase17:45377] zookeeper.ZKUtil(163): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:49,387 DEBUG [RS:0;jenkins-hbase17:40573] zookeeper.ZKUtil(163): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:49,387 WARN [RS:1;jenkins-hbase17:45377] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-05 21:52:49,394 WARN [RS:0;jenkins-hbase17:40573] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-05 21:52:49,394 INFO [RS:1;jenkins-hbase17:45377] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-05 21:52:49,395 INFO [RS:0;jenkins-hbase17:40573] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-05 21:52:49,395 DEBUG [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1951): logDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:49,395 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1951): logDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:49,397 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,40573,1704491567363] 2024-01-05 21:52:49,397 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,45377,1704491567565] 2024-01-05 21:52:49,401 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-01-05 21:52:49,404 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-01-05 21:52:49,412 DEBUG [RS:0;jenkins-hbase17:40573] zookeeper.ZKUtil(163): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:49,412 DEBUG [RS:1;jenkins-hbase17:45377] zookeeper.ZKUtil(163): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:49,412 DEBUG [RS:0;jenkins-hbase17:40573] zookeeper.ZKUtil(163): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:49,412 DEBUG [RS:1;jenkins-hbase17:45377] zookeeper.ZKUtil(163): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:49,422 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-05 21:52:49,422 DEBUG [RS:1;jenkins-hbase17:45377] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-05 21:52:49,430 INFO [RS:0;jenkins-hbase17:40573] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-05 21:52:49,430 INFO [RS:1;jenkins-hbase17:45377] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-05 21:52:49,449 INFO [RS:1;jenkins-hbase17:45377] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-05 21:52:49,449 INFO [RS:0;jenkins-hbase17:40573] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-05 21:52:49,453 INFO [RS:0;jenkins-hbase17:40573] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-05 21:52:49,453 INFO [RS:1;jenkins-hbase17:45377] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-05 21:52:49,454 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,454 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,458 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-05 21:52:49,458 INFO [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-05 21:52:49,466 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,466 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,466 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,466 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,467 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2024-01-05 21:52:49,467 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2024-01-05 21:52:49,467 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,468 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,468 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,468 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,468 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,468 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,468 DEBUG [RS:1;jenkins-hbase17:45377] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,468 DEBUG [RS:0;jenkins-hbase17:40573] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2024-01-05 21:52:49,469 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,469 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,469 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,469 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,469 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,470 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,470 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,470 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,489 INFO [RS:0;jenkins-hbase17:40573] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-05 21:52:49,489 INFO [RS:1;jenkins-hbase17:45377] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-05 21:52:49,492 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,40573,1704491567363-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,492 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,45377,1704491567565-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,513 INFO [RS:0;jenkins-hbase17:40573] regionserver.Replication(203): jenkins-hbase17.apache.org,40573,1704491567363 started 2024-01-05 21:52:49,513 INFO [RS:1;jenkins-hbase17:45377] regionserver.Replication(203): jenkins-hbase17.apache.org,45377,1704491567565 started 2024-01-05 21:52:49,514 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1640): Serving as jenkins-hbase17.apache.org,40573,1704491567363, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:40573, sessionid=0x100f99064610001 2024-01-05 21:52:49,514 INFO [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1640): Serving as jenkins-hbase17.apache.org,45377,1704491567565, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:45377, sessionid=0x100f99064610002 2024-01-05 21:52:49,514 DEBUG [RS:0;jenkins-hbase17:40573] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-05 21:52:49,514 DEBUG [RS:1;jenkins-hbase17:45377] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-05 21:52:49,514 DEBUG [RS:0;jenkins-hbase17:40573] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:49,514 DEBUG [RS:1;jenkins-hbase17:45377] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:49,515 DEBUG [RS:0;jenkins-hbase17:40573] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,40573,1704491567363' 2024-01-05 21:52:49,515 DEBUG [RS:1;jenkins-hbase17:45377] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,45377,1704491567565' 2024-01-05 21:52:49,515 DEBUG [RS:0;jenkins-hbase17:40573] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-05 21:52:49,515 DEBUG [RS:1;jenkins-hbase17:45377] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-05 21:52:49,516 DEBUG [RS:1;jenkins-hbase17:45377] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-05 21:52:49,516 DEBUG [RS:1;jenkins-hbase17:45377] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-05 21:52:49,517 DEBUG [RS:1;jenkins-hbase17:45377] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-05 21:52:49,517 DEBUG [RS:1;jenkins-hbase17:45377] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:49,517 DEBUG [RS:1;jenkins-hbase17:45377] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,45377,1704491567565' 2024-01-05 21:52:49,517 DEBUG [RS:1;jenkins-hbase17:45377] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-05 21:52:49,517 DEBUG [RS:1;jenkins-hbase17:45377] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-05 21:52:49,518 DEBUG [RS:1;jenkins-hbase17:45377] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-05 21:52:49,518 INFO [RS:1;jenkins-hbase17:45377] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-05 21:52:49,518 DEBUG [RS:0;jenkins-hbase17:40573] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-05 21:52:49,519 DEBUG [RS:0;jenkins-hbase17:40573] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-05 21:52:49,519 DEBUG [RS:0;jenkins-hbase17:40573] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-05 21:52:49,519 DEBUG [RS:0;jenkins-hbase17:40573] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:49,519 DEBUG [RS:0;jenkins-hbase17:40573] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,40573,1704491567363' 2024-01-05 21:52:49,520 DEBUG [RS:0;jenkins-hbase17:40573] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-05 21:52:49,520 DEBUG [RS:0;jenkins-hbase17:40573] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-05 21:52:49,521 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,521 DEBUG [RS:0;jenkins-hbase17:40573] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-05 21:52:49,521 INFO [RS:0;jenkins-hbase17:40573] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-05 21:52:49,522 DEBUG [RS:1;jenkins-hbase17:45377] zookeeper.ZKUtil(399): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-05 21:52:49,522 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,522 INFO [RS:1;jenkins-hbase17:45377] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-05 21:52:49,522 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,522 DEBUG [RS:0;jenkins-hbase17:40573] zookeeper.ZKUtil(399): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-05 21:52:49,522 INFO [RS:0;jenkins-hbase17:40573] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-05 21:52:49,522 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,522 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,523 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:49,557 DEBUG [jenkins-hbase17:43675] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-01-05 21:52:49,560 DEBUG [jenkins-hbase17:43675] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2024-01-05 21:52:49,566 DEBUG [jenkins-hbase17:43675] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-05 21:52:49,566 DEBUG [jenkins-hbase17:43675] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-05 21:52:49,566 DEBUG [jenkins-hbase17:43675] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-05 21:52:49,568 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,40573,1704491567363, state=OPENING 2024-01-05 21:52:49,574 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-01-05 21:52:49,575 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:52:49,576 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-05 21:52:49,579 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,40573,1704491567363}] 2024-01-05 21:52:49,643 INFO [RS:1;jenkins-hbase17:45377] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C45377%2C1704491567565, suffix=, logDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,45377,1704491567565, archiveDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/oldWALs, maxLogs=32 2024-01-05 21:52:49,658 INFO [RS:0;jenkins-hbase17:40573] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C40573%2C1704491567363, suffix=, logDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,40573,1704491567363, archiveDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/oldWALs, maxLogs=32 2024-01-05 21:52:49,675 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38801,DS-983a7978-0e4f-430e-bbe7-f099e58e0aae,DISK] 2024-01-05 21:52:49,675 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39771,DS-e766f585-6112-44a0-9d0f-eeb0e7206da6,DISK] 2024-01-05 21:52:49,683 INFO [RS:1;jenkins-hbase17:45377] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,45377,1704491567565/jenkins-hbase17.apache.org%2C45377%2C1704491567565.1704491569649 2024-01-05 21:52:49,706 DEBUG [RS:1;jenkins-hbase17:45377] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39771,DS-e766f585-6112-44a0-9d0f-eeb0e7206da6,DISK], DatanodeInfoWithStorage[127.0.0.1:38801,DS-983a7978-0e4f-430e-bbe7-f099e58e0aae,DISK]] 2024-01-05 21:52:49,734 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39771,DS-e766f585-6112-44a0-9d0f-eeb0e7206da6,DISK] 2024-01-05 21:52:49,734 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38801,DS-983a7978-0e4f-430e-bbe7-f099e58e0aae,DISK] 2024-01-05 21:52:49,741 INFO [RS:0;jenkins-hbase17:40573] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,40573,1704491567363/jenkins-hbase17.apache.org%2C40573%2C1704491567363.1704491569661 2024-01-05 21:52:49,742 DEBUG [RS:0;jenkins-hbase17:40573] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38801,DS-983a7978-0e4f-430e-bbe7-f099e58e0aae,DISK], DatanodeInfoWithStorage[127.0.0.1:39771,DS-e766f585-6112-44a0-9d0f-eeb0e7206da6,DISK]] 2024-01-05 21:52:49,767 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:49,769 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-05 21:52:49,772 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-05 21:52:49,787 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-01-05 21:52:49,788 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-05 21:52:49,792 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C40573%2C1704491567363.meta, suffix=.meta, logDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,40573,1704491567363, archiveDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/oldWALs, maxLogs=32 2024-01-05 21:52:49,810 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38801,DS-983a7978-0e4f-430e-bbe7-f099e58e0aae,DISK] 2024-01-05 21:52:49,813 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39771,DS-e766f585-6112-44a0-9d0f-eeb0e7206da6,DISK] 2024-01-05 21:52:49,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,40573,1704491567363/jenkins-hbase17.apache.org%2C40573%2C1704491567363.meta.1704491569794.meta 2024-01-05 21:52:49,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38801,DS-983a7978-0e4f-430e-bbe7-f099e58e0aae,DISK], DatanodeInfoWithStorage[127.0.0.1:39771,DS-e766f585-6112-44a0-9d0f-eeb0e7206da6,DISK]] 2024-01-05 21:52:49,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-01-05 21:52:49,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-01-05 21:52:49,843 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-01-05 21:52:49,849 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-01-05 21:52:49,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-01-05 21:52:49,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:49,862 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-01-05 21:52:49,862 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-01-05 21:52:49,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-05 21:52:49,868 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/info 2024-01-05 21:52:49,868 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/info 2024-01-05 21:52:49,868 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-05 21:52:49,869 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:49,869 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-05 21:52:49,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/rep_barrier 2024-01-05 21:52:49,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/rep_barrier 2024-01-05 21:52:49,872 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-05 21:52:49,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:49,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-05 21:52:49,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/table 2024-01-05 21:52:49,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/table 2024-01-05 21:52:49,875 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-05 21:52:49,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:49,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740 2024-01-05 21:52:49,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740 2024-01-05 21:52:49,885 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-05 21:52:49,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-05 21:52:49,897 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66516847, jitterRate=-0.008821740746498108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-05 21:52:49,897 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-05 21:52:49,910 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1704491569761 2024-01-05 21:52:49,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2024-01-05 21:52:49,932 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-01-05 21:52:49,933 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,40573,1704491567363, state=OPEN 2024-01-05 21:52:49,936 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-01-05 21:52:49,936 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-05 21:52:49,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-01-05 21:52:49,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,40573,1704491567363 in 357 msec 2024-01-05 21:52:49,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-01-05 21:52:49,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 566 msec 2024-01-05 21:52:49,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 891 msec 2024-01-05 21:52:49,964 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1704491569964, completionTime=-1 2024-01-05 21:52:49,964 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-01-05 21:52:49,965 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-01-05 21:52:50,037 DEBUG [hconnection-0x5e73bfe1-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-05 21:52:50,050 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-05 21:52:50,073 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-01-05 21:52:50,073 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1704491630073 2024-01-05 21:52:50,074 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1704491690074 2024-01-05 21:52:50,074 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 108 msec 2024-01-05 21:52:50,104 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43675,1704491566307-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:50,104 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43675,1704491566307-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:50,104 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43675,1704491566307-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:50,105 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:43675, period=300000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:50,106 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:50,114 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2024-01-05 21:52:50,124 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-01-05 21:52:50,125 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-05 21:52:50,135 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-01-05 21:52:50,139 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-01-05 21:52:50,143 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-05 21:52:50,169 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,172 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542 empty. 2024-01-05 21:52:50,173 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,174 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-01-05 21:52:50,230 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-01-05 21:52:50,232 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3a265a5f70a83a2419ecfe391452c542, NAME => 'hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp 2024-01-05 21:52:50,260 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:50,260 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3a265a5f70a83a2419ecfe391452c542, disabling compactions & flushes 2024-01-05 21:52:50,261 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:52:50,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:52:50,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. after waiting 0 ms 2024-01-05 21:52:50,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:52:50,261 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:52:50,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3a265a5f70a83a2419ecfe391452c542: 2024-01-05 21:52:50,267 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-01-05 21:52:50,281 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1704491570270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491570270"}]},"ts":"1704491570270"} 2024-01-05 21:52:50,309 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-05 21:52:50,312 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-05 21:52:50,316 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491570312"}]},"ts":"1704491570312"} 2024-01-05 21:52:50,320 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-01-05 21:52:50,324 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2024-01-05 21:52:50,325 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-05 21:52:50,325 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-05 21:52:50,325 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-05 21:52:50,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3a265a5f70a83a2419ecfe391452c542, ASSIGN}] 2024-01-05 21:52:50,331 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3a265a5f70a83a2419ecfe391452c542, ASSIGN 2024-01-05 21:52:50,333 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3a265a5f70a83a2419ecfe391452c542, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40573,1704491567363; forceNewPlan=false, retain=false 2024-01-05 21:52:50,487 INFO [jenkins-hbase17:43675] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-05 21:52:50,488 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3a265a5f70a83a2419ecfe391452c542, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:50,489 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1704491570488"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491570488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491570488"}]},"ts":"1704491570488"} 2024-01-05 21:52:50,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3a265a5f70a83a2419ecfe391452c542, server=jenkins-hbase17.apache.org,40573,1704491567363}] 2024-01-05 21:52:50,652 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:50,659 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:52:50,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a265a5f70a83a2419ecfe391452c542, NAME => 'hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542.', STARTKEY => '', ENDKEY => ''} 2024-01-05 21:52:50,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:50,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,664 INFO [StoreOpener-3a265a5f70a83a2419ecfe391452c542-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,667 DEBUG [StoreOpener-3a265a5f70a83a2419ecfe391452c542-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542/info 2024-01-05 21:52:50,667 DEBUG [StoreOpener-3a265a5f70a83a2419ecfe391452c542-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542/info 2024-01-05 21:52:50,668 INFO [StoreOpener-3a265a5f70a83a2419ecfe391452c542-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a265a5f70a83a2419ecfe391452c542 columnFamilyName info 2024-01-05 21:52:50,669 INFO [StoreOpener-3a265a5f70a83a2419ecfe391452c542-1] regionserver.HStore(310): Store=3a265a5f70a83a2419ecfe391452c542/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:50,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:52:50,684 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:50,685 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 3a265a5f70a83a2419ecfe391452c542; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59122427, jitterRate=-0.1190071851015091}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-05 21:52:50,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 3a265a5f70a83a2419ecfe391452c542: 2024-01-05 21:52:50,687 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542., pid=6, masterSystemTime=1704491570652 2024-01-05 21:52:50,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:52:50,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:52:50,693 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3a265a5f70a83a2419ecfe391452c542, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:50,693 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1704491570693"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1704491570693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704491570693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704491570693"}]},"ts":"1704491570693"} 2024-01-05 21:52:50,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-01-05 21:52:50,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3a265a5f70a83a2419ecfe391452c542, server=jenkins-hbase17.apache.org,40573,1704491567363 in 201 msec 2024-01-05 21:52:50,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-01-05 21:52:50,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3a265a5f70a83a2419ecfe391452c542, ASSIGN in 373 msec 2024-01-05 21:52:50,707 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-05 21:52:50,707 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491570707"}]},"ts":"1704491570707"} 2024-01-05 21:52:50,711 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-01-05 21:52:50,714 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-01-05 21:52:50,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 587 msec 2024-01-05 21:52:50,739 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-01-05 21:52:50,740 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-01-05 21:52:50,740 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:52:50,772 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-01-05 21:52:50,796 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-05 21:52:50,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2024-01-05 21:52:50,816 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-01-05 21:52:50,828 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-05 21:52:50,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2024-01-05 21:52:50,842 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-01-05 21:52:50,843 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-01-05 21:52:50,844 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.699sec 2024-01-05 21:52:50,846 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-01-05 21:52:50,846 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-05 21:52:50,848 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-01-05 21:52:50,848 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-01-05 21:52:50,851 INFO [master/jenkins-hbase17:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-01-05 21:52:50,851 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-01-05 21:52:50,853 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-05 21:52:50,856 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/hbase/quota/56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:50,857 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/hbase/quota/56d13a12cc61334f95442901a786d7b4 empty. 2024-01-05 21:52:50,860 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/hbase/quota/56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:50,860 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-01-05 21:52:50,860 INFO [master/jenkins-hbase17:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-01-05 21:52:50,860 INFO [master/jenkins-hbase17:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-01-05 21:52:50,862 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:50,862 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:50,864 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-01-05 21:52:50,864 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-01-05 21:52:50,865 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43675,1704491566307-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-01-05 21:52:50,866 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43675,1704491566307-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-01-05 21:52:50,887 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-01-05 21:52:50,887 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,43675,1704491566307-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-05 21:52:50,890 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-01-05 21:52:50,891 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 56d13a12cc61334f95442901a786d7b4, NAME => 'hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp 2024-01-05 21:52:50,913 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:50,913 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 56d13a12cc61334f95442901a786d7b4, disabling compactions & flushes 2024-01-05 21:52:50,913 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:52:50,913 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:52:50,913 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. after waiting 0 ms 2024-01-05 21:52:50,913 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:52:50,913 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:52:50,913 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 56d13a12cc61334f95442901a786d7b4: 2024-01-05 21:52:50,919 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-01-05 21:52:50,921 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1704491570920"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491570920"}]},"ts":"1704491570920"} 2024-01-05 21:52:50,922 DEBUG [Listener at localhost/39519] zookeeper.ReadOnlyZKClient(139): Connect 0x0ba1fc90 to 127.0.0.1:61550 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-05 21:52:50,925 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-05 21:52:50,927 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-05 21:52:50,927 DEBUG [Listener at localhost/39519] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12af9e99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-05 21:52:50,927 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491570927"}]},"ts":"1704491570927"} 2024-01-05 21:52:50,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-01-05 21:52:50,935 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2024-01-05 21:52:50,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-05 21:52:50,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-05 21:52:50,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-05 21:52:50,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=56d13a12cc61334f95442901a786d7b4, ASSIGN}] 2024-01-05 21:52:50,940 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=56d13a12cc61334f95442901a786d7b4, ASSIGN 2024-01-05 21:52:50,941 DEBUG [hconnection-0x359084a0-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-05 21:52:50,942 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=56d13a12cc61334f95442901a786d7b4, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40573,1704491567363; forceNewPlan=false, retain=false 2024-01-05 21:52:50,952 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-05 21:52:50,961 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:52:50,963 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:50,966 DEBUG [Listener at localhost/39519] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-05 21:52:51,071 DEBUG [Listener at localhost/39519] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-05 21:52:51,092 INFO [jenkins-hbase17:43675] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-05 21:52:51,094 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=56d13a12cc61334f95442901a786d7b4, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:51,094 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1704491571094"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491571094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491571094"}]},"ts":"1704491571094"} 2024-01-05 21:52:51,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 56d13a12cc61334f95442901a786d7b4, server=jenkins-hbase17.apache.org,40573,1704491567363}] 2024-01-05 21:52:51,175 DEBUG [Listener at localhost/39519] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-05 21:52:51,255 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:51,266 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:52:51,266 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 56d13a12cc61334f95442901a786d7b4, NAME => 'hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4.', STARTKEY => '', ENDKEY => ''} 2024-01-05 21:52:51,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:51,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:51,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:51,267 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:51,270 INFO [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:51,273 DEBUG [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/q 2024-01-05 21:52:51,273 DEBUG [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/q 2024-01-05 21:52:51,273 INFO [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56d13a12cc61334f95442901a786d7b4 columnFamilyName q 2024-01-05 21:52:51,274 INFO [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] regionserver.HStore(310): Store=56d13a12cc61334f95442901a786d7b4/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:51,274 INFO [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:51,276 DEBUG [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/u 2024-01-05 21:52:51,276 DEBUG [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/u 2024-01-05 21:52:51,277 INFO [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56d13a12cc61334f95442901a786d7b4 columnFamilyName u 2024-01-05 21:52:51,277 DEBUG [Listener at localhost/39519] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-05 21:52:51,278 INFO [StoreOpener-56d13a12cc61334f95442901a786d7b4-1] regionserver.HStore(310): Store=56d13a12cc61334f95442901a786d7b4/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:51,281 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:51,281 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:51,285 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-01-05 21:52:51,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 56d13a12cc61334f95442901a786d7b4 2024-01-05 21:52:51,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:51,291 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 56d13a12cc61334f95442901a786d7b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68501720, jitterRate=0.02075517177581787}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-01-05 21:52:51,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 56d13a12cc61334f95442901a786d7b4: 2024-01-05 21:52:51,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4., pid=11, masterSystemTime=1704491571255 2024-01-05 21:52:51,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:52:51,295 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:52:51,296 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=56d13a12cc61334f95442901a786d7b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:51,296 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1704491571296"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1704491571296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704491571296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704491571296"}]},"ts":"1704491571296"} 2024-01-05 21:52:51,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-01-05 21:52:51,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 56d13a12cc61334f95442901a786d7b4, server=jenkins-hbase17.apache.org,40573,1704491567363 in 197 msec 2024-01-05 21:52:51,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-01-05 21:52:51,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=56d13a12cc61334f95442901a786d7b4, ASSIGN in 364 msec 2024-01-05 21:52:51,305 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-05 21:52:51,305 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491571305"}]},"ts":"1704491571305"} 2024-01-05 21:52:51,307 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-01-05 21:52:51,309 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-01-05 21:52:51,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 464 msec 2024-01-05 21:52:51,389 DEBUG [Listener at localhost/39519] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-05 21:52:51,392 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-01-05 21:52:51,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$4(2118): Client=jenkins//136.243.18.41 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-05 21:52:51,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-01-05 21:52:51,422 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-05 21:52:51,425 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-05 21:52:51,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-01-05 21:52:51,427 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,428 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812 empty. 2024-01-05 21:52:51,429 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,429 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-05 21:52:51,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-05 21:52:51,451 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-01-05 21:52:51,452 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2677f82028ac9f0e4fc6a9b0ce6ea812, NAME => 'TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp 2024-01-05 21:52:51,467 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:51,468 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 2677f82028ac9f0e4fc6a9b0ce6ea812, disabling compactions & flushes 2024-01-05 21:52:51,468 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:52:51,468 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:52:51,468 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. after waiting 0 ms 2024-01-05 21:52:51,468 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:52:51,468 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:52:51,468 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 2677f82028ac9f0e4fc6a9b0ce6ea812: 2024-01-05 21:52:51,472 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-01-05 21:52:51,474 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491571474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491571474"}]},"ts":"1704491571474"} 2024-01-05 21:52:51,477 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-05 21:52:51,478 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-05 21:52:51,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491571478"}]},"ts":"1704491571478"} 2024-01-05 21:52:51,481 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-01-05 21:52:51,484 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2024-01-05 21:52:51,485 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-05 21:52:51,485 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-05 21:52:51,485 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-05 21:52:51,485 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=2677f82028ac9f0e4fc6a9b0ce6ea812, ASSIGN}] 2024-01-05 21:52:51,487 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=2677f82028ac9f0e4fc6a9b0ce6ea812, ASSIGN 2024-01-05 21:52:51,488 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=2677f82028ac9f0e4fc6a9b0ce6ea812, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45377,1704491567565; forceNewPlan=false, retain=false 2024-01-05 21:52:51,638 INFO [jenkins-hbase17:43675] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-05 21:52:51,639 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2677f82028ac9f0e4fc6a9b0ce6ea812, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:51,640 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491571639"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491571639"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491571639"}]},"ts":"1704491571639"} 2024-01-05 21:52:51,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 2677f82028ac9f0e4fc6a9b0ce6ea812, server=jenkins-hbase17.apache.org,45377,1704491567565}] 2024-01-05 21:52:51,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-05 21:52:51,796 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:51,796 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-05 21:52:51,800 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-05 21:52:51,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:52:51,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2677f82028ac9f0e4fc6a9b0ce6ea812, NAME => 'TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.', STARTKEY => '', ENDKEY => ''} 2024-01-05 21:52:51,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:51,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,816 INFO [StoreOpener-2677f82028ac9f0e4fc6a9b0ce6ea812-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,818 DEBUG [StoreOpener-2677f82028ac9f0e4fc6a9b0ce6ea812-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/cf 2024-01-05 21:52:51,818 DEBUG [StoreOpener-2677f82028ac9f0e4fc6a9b0ce6ea812-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/cf 2024-01-05 21:52:51,819 INFO [StoreOpener-2677f82028ac9f0e4fc6a9b0ce6ea812-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2677f82028ac9f0e4fc6a9b0ce6ea812 columnFamilyName cf 2024-01-05 21:52:51,820 INFO [StoreOpener-2677f82028ac9f0e4fc6a9b0ce6ea812-1] regionserver.HStore(310): Store=2677f82028ac9f0e4fc6a9b0ce6ea812/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:51,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:52:51,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:51,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2677f82028ac9f0e4fc6a9b0ce6ea812; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60852134, jitterRate=-0.09323254227638245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-05 21:52:51,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2677f82028ac9f0e4fc6a9b0ce6ea812: 2024-01-05 21:52:51,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812., pid=14, masterSystemTime=1704491571796 2024-01-05 21:52:51,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:52:51,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:52:51,839 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2677f82028ac9f0e4fc6a9b0ce6ea812, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:51,840 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491571839"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1704491571839"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704491571839"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704491571839"}]},"ts":"1704491571839"} 2024-01-05 21:52:51,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-01-05 21:52:51,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 2677f82028ac9f0e4fc6a9b0ce6ea812, server=jenkins-hbase17.apache.org,45377,1704491567565 in 200 msec 2024-01-05 21:52:51,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-01-05 21:52:51,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=2677f82028ac9f0e4fc6a9b0ce6ea812, ASSIGN in 361 msec 2024-01-05 21:52:51,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-05 21:52:51,850 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491571850"}]},"ts":"1704491571850"} 2024-01-05 21:52:51,853 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-01-05 21:52:51,857 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-01-05 21:52:51,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 440 msec 2024-01-05 21:52:52,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-05 21:52:52,193 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-01-05 21:52:52,194 DEBUG [Listener at localhost/39519] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-01-05 21:52:52,194 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:52,200 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-01-05 21:52:52,201 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:52,201 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-01-05 21:52:52,201 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:52,213 DEBUG [hconnection-0x359084a0-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-05 21:52:52,216 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-05 21:52:52,221 DEBUG [regionserver/jenkins-hbase17:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-05 21:52:52,223 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-01-05 21:52:52,225 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43675] master.HMaster$4(2118): Client=jenkins//136.243.18.41 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-05 21:52:52,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-01-05 21:52:52,230 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-05 21:52:52,231 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43675] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-01-05 21:52:52,232 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-05 21:52:52,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-05 21:52:52,235 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,235 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c empty. 2024-01-05 21:52:52,236 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,236 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-05 21:52:52,259 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-01-05 21:52:52,261 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 820bbaa5cd243dddaa67d6cd4f1bc43c, NAME => 'TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp 2024-01-05 21:52:52,266 DEBUG [hconnection-0x11cb2ead-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-05 21:52:52,269 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-01-05 21:52:52,281 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:52,282 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 820bbaa5cd243dddaa67d6cd4f1bc43c, disabling compactions & flushes 2024-01-05 21:52:52,282 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:52:52,282 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:52:52,282 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. after waiting 0 ms 2024-01-05 21:52:52,282 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:52:52,282 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:52:52,282 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 820bbaa5cd243dddaa67d6cd4f1bc43c: 2024-01-05 21:52:52,288 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-01-05 21:52:52,289 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491572289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491572289"}]},"ts":"1704491572289"} 2024-01-05 21:52:52,292 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-05 21:52:52,293 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-05 21:52:52,293 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491572293"}]},"ts":"1704491572293"} 2024-01-05 21:52:52,295 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-01-05 21:52:52,299 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2024-01-05 21:52:52,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-05 21:52:52,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-05 21:52:52,300 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-05 21:52:52,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=820bbaa5cd243dddaa67d6cd4f1bc43c, ASSIGN}] 2024-01-05 21:52:52,302 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=820bbaa5cd243dddaa67d6cd4f1bc43c, ASSIGN 2024-01-05 21:52:52,303 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=820bbaa5cd243dddaa67d6cd4f1bc43c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45377,1704491567565; forceNewPlan=false, retain=false 2024-01-05 21:52:52,453 INFO [jenkins-hbase17:43675] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-05 21:52:52,454 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=820bbaa5cd243dddaa67d6cd4f1bc43c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:52,454 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491572454"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491572454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491572454"}]},"ts":"1704491572454"} 2024-01-05 21:52:52,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 820bbaa5cd243dddaa67d6cd4f1bc43c, server=jenkins-hbase17.apache.org,45377,1704491567565}] 2024-01-05 21:52:52,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-05 21:52:52,609 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:52,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:52:52,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 820bbaa5cd243dddaa67d6cd4f1bc43c, NAME => 'TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.', STARTKEY => '', ENDKEY => ''} 2024-01-05 21:52:52,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:52,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,617 INFO [StoreOpener-820bbaa5cd243dddaa67d6cd4f1bc43c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,620 DEBUG [StoreOpener-820bbaa5cd243dddaa67d6cd4f1bc43c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c/cf 2024-01-05 21:52:52,620 DEBUG [StoreOpener-820bbaa5cd243dddaa67d6cd4f1bc43c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c/cf 2024-01-05 21:52:52,620 INFO [StoreOpener-820bbaa5cd243dddaa67d6cd4f1bc43c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 820bbaa5cd243dddaa67d6cd4f1bc43c columnFamilyName cf 2024-01-05 21:52:52,621 INFO [StoreOpener-820bbaa5cd243dddaa67d6cd4f1bc43c-1] regionserver.HStore(310): Store=820bbaa5cd243dddaa67d6cd4f1bc43c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:52,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:52:52,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:52,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 820bbaa5cd243dddaa67d6cd4f1bc43c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61295358, jitterRate=-0.08662799000740051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-05 21:52:52,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 820bbaa5cd243dddaa67d6cd4f1bc43c: 2024-01-05 21:52:52,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c., pid=17, masterSystemTime=1704491572609 2024-01-05 21:52:52,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:52:52,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:52:52,640 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=820bbaa5cd243dddaa67d6cd4f1bc43c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:52,640 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491572639"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1704491572639"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704491572639"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704491572639"}]},"ts":"1704491572639"} 2024-01-05 21:52:52,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-01-05 21:52:52,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 820bbaa5cd243dddaa67d6cd4f1bc43c, server=jenkins-hbase17.apache.org,45377,1704491567565 in 187 msec 2024-01-05 21:52:52,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-01-05 21:52:52,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=820bbaa5cd243dddaa67d6cd4f1bc43c, ASSIGN in 347 msec 2024-01-05 21:52:52,654 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-05 21:52:52,654 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491572654"}]},"ts":"1704491572654"} 2024-01-05 21:52:52,656 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-01-05 21:52:52,659 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-01-05 21:52:52,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 435 msec 2024-01-05 21:52:52,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-05 21:52:52,986 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-01-05 21:52:52,987 DEBUG [Listener at localhost/39519] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-01-05 21:52:52,987 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:52,990 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-01-05 21:52:52,990 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:52,990 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-01-05 21:52:52,990 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:53,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$4(2118): Client=jenkins//136.243.18.41 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-05 21:52:53,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-01-05 21:52:53,007 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-05 21:52:53,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-01-05 21:52:53,008 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-05 21:52:53,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-05 21:52:53,011 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,011 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff empty. 2024-01-05 21:52:53,012 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,012 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-05 21:52:53,041 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-01-05 21:52:53,043 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 197b3477ef59f93240e194b3dbc2bbff, NAME => 'TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp 2024-01-05 21:52:53,071 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:53,072 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 197b3477ef59f93240e194b3dbc2bbff, disabling compactions & flushes 2024-01-05 21:52:53,072 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:52:53,072 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:52:53,072 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. after waiting 0 ms 2024-01-05 21:52:53,072 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:52:53,072 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:52:53,072 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 197b3477ef59f93240e194b3dbc2bbff: 2024-01-05 21:52:53,077 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-01-05 21:52:53,079 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491573079"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491573079"}]},"ts":"1704491573079"} 2024-01-05 21:52:53,081 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-05 21:52:53,083 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-05 21:52:53,083 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491573083"}]},"ts":"1704491573083"} 2024-01-05 21:52:53,085 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-01-05 21:52:53,089 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2024-01-05 21:52:53,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-05 21:52:53,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-05 21:52:53,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-05 21:52:53,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=197b3477ef59f93240e194b3dbc2bbff, ASSIGN}] 2024-01-05 21:52:53,092 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=197b3477ef59f93240e194b3dbc2bbff, ASSIGN 2024-01-05 21:52:53,093 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=197b3477ef59f93240e194b3dbc2bbff, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40573,1704491567363; forceNewPlan=false, retain=false 2024-01-05 21:52:53,244 INFO [jenkins-hbase17:43675] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-05 21:52:53,245 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=197b3477ef59f93240e194b3dbc2bbff, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:53,245 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491573245"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491573245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491573245"}]},"ts":"1704491573245"} 2024-01-05 21:52:53,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 197b3477ef59f93240e194b3dbc2bbff, server=jenkins-hbase17.apache.org,40573,1704491567363}] 2024-01-05 21:52:53,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-05 21:52:53,402 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:53,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:52:53,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 197b3477ef59f93240e194b3dbc2bbff, NAME => 'TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.', STARTKEY => '', ENDKEY => ''} 2024-01-05 21:52:53,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:53,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,411 INFO [StoreOpener-197b3477ef59f93240e194b3dbc2bbff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,413 DEBUG [StoreOpener-197b3477ef59f93240e194b3dbc2bbff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff/cf 2024-01-05 21:52:53,413 DEBUG [StoreOpener-197b3477ef59f93240e194b3dbc2bbff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff/cf 2024-01-05 21:52:53,413 INFO [StoreOpener-197b3477ef59f93240e194b3dbc2bbff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 197b3477ef59f93240e194b3dbc2bbff columnFamilyName cf 2024-01-05 21:52:53,414 INFO [StoreOpener-197b3477ef59f93240e194b3dbc2bbff-1] regionserver.HStore(310): Store=197b3477ef59f93240e194b3dbc2bbff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:53,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:52:53,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:53,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 197b3477ef59f93240e194b3dbc2bbff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60895567, jitterRate=-0.09258534014225006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-05 21:52:53,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 197b3477ef59f93240e194b3dbc2bbff: 2024-01-05 21:52:53,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff., pid=20, masterSystemTime=1704491573402 2024-01-05 21:52:53,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:52:53,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:52:53,435 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=197b3477ef59f93240e194b3dbc2bbff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:53,435 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491573435"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1704491573435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704491573435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704491573435"}]},"ts":"1704491573435"} 2024-01-05 21:52:53,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-01-05 21:52:53,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 197b3477ef59f93240e194b3dbc2bbff, server=jenkins-hbase17.apache.org,40573,1704491567363 in 190 msec 2024-01-05 21:52:53,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-01-05 21:52:53,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=197b3477ef59f93240e194b3dbc2bbff, ASSIGN in 351 msec 2024-01-05 21:52:53,447 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-05 21:52:53,447 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491573447"}]},"ts":"1704491573447"} 2024-01-05 21:52:53,449 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-01-05 21:52:53,452 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-01-05 21:52:53,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 449 msec 2024-01-05 21:52:53,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-05 21:52:53,763 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-01-05 21:52:53,763 DEBUG [Listener at localhost/39519] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-01-05 21:52:53,763 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:53,767 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-01-05 21:52:53,768 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:53,768 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-01-05 21:52:53,768 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:53,780 DEBUG [regionserver/jenkins-hbase17:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-05 21:52:53,785 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-01-05 21:52:53,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$15(3020): Client=jenkins//136.243.18.41 creating {NAME => 'TestNs'} 2024-01-05 21:52:53,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-01-05 21:52:53,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-05 21:52:53,809 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-05 21:52:53,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 23 msec 2024-01-05 21:52:54,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-05 21:52:54,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$4(2118): Client=jenkins//136.243.18.41 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-05 21:52:54,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-01-05 21:52:54,064 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-01-05 21:52:54,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-01-05 21:52:54,065 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-05 21:52:54,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-05 21:52:54,068 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,068 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,069 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa empty. 2024-01-05 21:52:54,069 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b empty. 2024-01-05 21:52:54,070 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,070 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,070 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-05 21:52:54,088 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-01-05 21:52:54,090 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b57cd424eaa719714c6cd708a2497aa, NAME => 'TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp 2024-01-05 21:52:54,091 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0f5937f77535ae9913fc69dfadd1989b, NAME => 'TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp 2024-01-05 21:52:54,113 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:54,114 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 5b57cd424eaa719714c6cd708a2497aa, disabling compactions & flushes 2024-01-05 21:52:54,114 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:52:54,114 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:52:54,114 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. after waiting 0 ms 2024-01-05 21:52:54,114 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:52:54,114 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:52:54,114 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:54,115 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 5b57cd424eaa719714c6cd708a2497aa: 2024-01-05 21:52:54,115 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 0f5937f77535ae9913fc69dfadd1989b, disabling compactions & flushes 2024-01-05 21:52:54,115 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:52:54,115 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:52:54,115 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. after waiting 0 ms 2024-01-05 21:52:54,115 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:52:54,115 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:52:54,115 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 0f5937f77535ae9913fc69dfadd1989b: 2024-01-05 21:52:54,119 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-01-05 21:52:54,121 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491574121"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491574121"}]},"ts":"1704491574121"} 2024-01-05 21:52:54,121 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491574121"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491574121"}]},"ts":"1704491574121"} 2024-01-05 21:52:54,125 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-01-05 21:52:54,127 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-05 21:52:54,127 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491574127"}]},"ts":"1704491574127"} 2024-01-05 21:52:54,129 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-01-05 21:52:54,135 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2024-01-05 21:52:54,137 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-05 21:52:54,137 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-05 21:52:54,137 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-05 21:52:54,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=5b57cd424eaa719714c6cd708a2497aa, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0f5937f77535ae9913fc69dfadd1989b, ASSIGN}] 2024-01-05 21:52:54,140 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0f5937f77535ae9913fc69dfadd1989b, ASSIGN 2024-01-05 21:52:54,140 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=5b57cd424eaa719714c6cd708a2497aa, ASSIGN 2024-01-05 21:52:54,141 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=5b57cd424eaa719714c6cd708a2497aa, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,40573,1704491567363; forceNewPlan=false, retain=false 2024-01-05 21:52:54,141 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=0f5937f77535ae9913fc69dfadd1989b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,45377,1704491567565; forceNewPlan=false, retain=false 2024-01-05 21:52:54,292 INFO [jenkins-hbase17:43675] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-01-05 21:52:54,293 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=0f5937f77535ae9913fc69dfadd1989b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:54,293 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5b57cd424eaa719714c6cd708a2497aa, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:54,293 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491574292"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491574292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491574292"}]},"ts":"1704491574292"} 2024-01-05 21:52:54,293 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491574292"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491574292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491574292"}]},"ts":"1704491574292"} 2024-01-05 21:52:54,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 0f5937f77535ae9913fc69dfadd1989b, server=jenkins-hbase17.apache.org,45377,1704491567565}] 2024-01-05 21:52:54,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure 5b57cd424eaa719714c6cd708a2497aa, server=jenkins-hbase17.apache.org,40573,1704491567363}] 2024-01-05 21:52:54,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-05 21:52:54,449 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:54,451 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:54,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:52:54,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f5937f77535ae9913fc69dfadd1989b, NAME => 'TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.', STARTKEY => '1', ENDKEY => ''} 2024-01-05 21:52:54,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:54,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:52:54,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b57cd424eaa719714c6cd708a2497aa, NAME => 'TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.', STARTKEY => '', ENDKEY => '1'} 2024-01-05 21:52:54,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-05 21:52:54,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,457 INFO [StoreOpener-0f5937f77535ae9913fc69dfadd1989b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,459 INFO [StoreOpener-5b57cd424eaa719714c6cd708a2497aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,460 DEBUG [StoreOpener-0f5937f77535ae9913fc69dfadd1989b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b/cf 2024-01-05 21:52:54,460 DEBUG [StoreOpener-0f5937f77535ae9913fc69dfadd1989b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b/cf 2024-01-05 21:52:54,460 INFO [StoreOpener-0f5937f77535ae9913fc69dfadd1989b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f5937f77535ae9913fc69dfadd1989b columnFamilyName cf 2024-01-05 21:52:54,461 INFO [StoreOpener-0f5937f77535ae9913fc69dfadd1989b-1] regionserver.HStore(310): Store=0f5937f77535ae9913fc69dfadd1989b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:54,461 DEBUG [StoreOpener-5b57cd424eaa719714c6cd708a2497aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa/cf 2024-01-05 21:52:54,462 DEBUG [StoreOpener-5b57cd424eaa719714c6cd708a2497aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa/cf 2024-01-05 21:52:54,463 INFO [StoreOpener-5b57cd424eaa719714c6cd708a2497aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b57cd424eaa719714c6cd708a2497aa columnFamilyName cf 2024-01-05 21:52:54,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,463 INFO [StoreOpener-5b57cd424eaa719714c6cd708a2497aa-1] regionserver.HStore(310): Store=5b57cd424eaa719714c6cd708a2497aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-05 21:52:54,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:52:54,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:52:54,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:54,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0f5937f77535ae9913fc69dfadd1989b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74825772, jitterRate=0.11499089002609253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-05 21:52:54,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0f5937f77535ae9913fc69dfadd1989b: 2024-01-05 21:52:54,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-05 21:52:54,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b., pid=25, masterSystemTime=1704491574449 2024-01-05 21:52:54,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 5b57cd424eaa719714c6cd708a2497aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71630113, jitterRate=0.06737186014652252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-05 21:52:54,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 5b57cd424eaa719714c6cd708a2497aa: 2024-01-05 21:52:54,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa., pid=26, masterSystemTime=1704491574451 2024-01-05 21:52:54,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:52:54,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:52:54,477 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=0f5937f77535ae9913fc69dfadd1989b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:52:54,477 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491574477"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1704491574477"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704491574477"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704491574477"}]},"ts":"1704491574477"} 2024-01-05 21:52:54,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:52:54,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:52:54,479 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=5b57cd424eaa719714c6cd708a2497aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:52:54,480 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491574479"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1704491574479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704491574479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704491574479"}]},"ts":"1704491574479"} 2024-01-05 21:52:54,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-01-05 21:52:54,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 0f5937f77535ae9913fc69dfadd1989b, server=jenkins-hbase17.apache.org,45377,1704491567565 in 185 msec 2024-01-05 21:52:54,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-01-05 21:52:54,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure 5b57cd424eaa719714c6cd708a2497aa, server=jenkins-hbase17.apache.org,40573,1704491567363 in 185 msec 2024-01-05 21:52:54,487 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0f5937f77535ae9913fc69dfadd1989b, ASSIGN in 347 msec 2024-01-05 21:52:54,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-01-05 21:52:54,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=5b57cd424eaa719714c6cd708a2497aa, ASSIGN in 349 msec 2024-01-05 21:52:54,490 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-05 21:52:54,490 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491574490"}]},"ts":"1704491574490"} 2024-01-05 21:52:54,493 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-01-05 21:52:54,497 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-01-05 21:52:54,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 439 msec 2024-01-05 21:52:54,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-05 21:52:54,820 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-01-05 21:52:54,821 DEBUG [Listener at localhost/39519] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-01-05 21:52:54,821 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:54,827 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-01-05 21:52:54,828 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:54,828 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-01-05 21:52:54,828 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:54,878 INFO [Listener at localhost/39519] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=304, OpenFileDescriptor=630, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=168, AvailableMemoryMB=2549 2024-01-05 21:52:55,196 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:55,196 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:52:55,196 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704495174944 bypass), TestNs=QuotaState(ts=1704495174944 bypass)} 2024-01-05 21:52:55,197 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704495174944 bypass), TestQuotaAdmin2=QuotaState(ts=1704495174944 bypass)} 2024-01-05 21:52:55,197 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704495174944 [ TestNs:TestTable ])} 2024-01-05 21:52:55,197 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704495174944 bypass)} 2024-01-05 21:52:55,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-01-05 21:52:55,447 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:52:55,447 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:52:55,448 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704495174944 bypass), TestNs=QuotaState(ts=1704495174944 bypass)} 2024-01-05 21:52:55,448 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704495174944 bypass), TestNs:TestTable=QuotaState(ts=1704495174944 bypass), TestQuotaAdmin1=QuotaState(ts=1704495174944 bypass)} 2024-01-05 21:52:55,448 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704495174944 [ TestNs:TestTable ])} 2024-01-05 21:52:55,448 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704495174944 bypass)} 2024-01-05 21:52:55,454 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-01-05 21:52:55,455 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-01-05 21:52:55,455 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-01-05 21:52:55,456 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-01-05 21:52:55,456 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-01-05 21:52:55,457 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-01-05 21:52:55,457 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-01-05 21:52:55,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:55,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491585473, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:55,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:55,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491585473, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:56,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:56,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491585473, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:56,429 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-05 21:52:56,429 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-01-05 21:52:56,430 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-05 21:52:56,430 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-01-05 21:52:56,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:56,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491585472, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:58,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:52:58,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491585473, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:00,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:00,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491585472, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:00,782 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10358: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:00,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:00,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 136.243.18.41:56924 deadline: 1704491590786, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:01,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:01,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 136.243.18.41:56924 deadline: 1704491590786, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:01,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:01,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 136.243.18.41:56924 deadline: 1704491590786, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:02,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:02,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 136.243.18.41:56924 deadline: 1704491590786, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:03,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:03,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 136.243.18.41:56924 deadline: 1704491590786, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:06,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:06,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 136.243.18.41:56924 deadline: 1704491590786, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:06,083 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10307: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:06,345 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:06,345 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:06,345 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704498774944 bypass), TestNs=QuotaState(ts=1704498774944 bypass)} 2024-01-05 21:53:06,345 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704498774944 bypass), TestQuotaAdmin2=QuotaState(ts=1704498774944 bypass)} 2024-01-05 21:53:06,345 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704498774944 bypass)} 2024-01-05 21:53:06,345 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704498774944 bypass)} 2024-01-05 21:53:06,596 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:06,596 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:06,596 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704498774944 bypass), TestNs=QuotaState(ts=1704498774944 bypass)} 2024-01-05 21:53:06,596 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704498774944 bypass), TestNs:TestTable=QuotaState(ts=1704498774944 bypass), TestQuotaAdmin1=QuotaState(ts=1704498774944 bypass)} 2024-01-05 21:53:06,596 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704498774944 bypass)} 2024-01-05 21:53:06,596 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704498774944 bypass)} 2024-01-05 21:53:06,608 INFO [Listener at localhost/39519] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=289 (was 304), OpenFileDescriptor=599 (was 630), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=307 (was 281) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 168), AvailableMemoryMB=2393 (was 2549) 2024-01-05 21:53:06,619 INFO [Listener at localhost/39519] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=289, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=165, AvailableMemoryMB=2393 2024-01-05 21:53:06,884 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:06,884 INFO [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-05 21:53:07,134 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:07,135 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704502375044 bypass), TestNs=QuotaState(ts=1704502375044 bypass)} 2024-01-05 21:53:07,136 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704502375044 bypass), TestQuotaAdmin2=QuotaState(ts=1704502375044 bypass)} 2024-01-05 21:53:07,136 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704502375044 [ default ])} 2024-01-05 21:53:07,136 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704502375044 bypass)} 2024-01-05 21:53:07,386 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:07,387 INFO [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-05 21:53:07,637 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:07,638 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704502375144 bypass), TestNs=QuotaState(ts=1704502375144 bypass)} 2024-01-05 21:53:07,639 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704502375144 bypass), TestNs:TestTable=QuotaState(ts=1704502375144 bypass), TestQuotaAdmin1=QuotaState(ts=1704502375144 bypass)} 2024-01-05 21:53:07,639 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704502375144 [ default ])} 2024-01-05 21:53:07,639 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704502375144 bypass)} 2024-01-05 21:53:07,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:07,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 136.243.18.41:56924 deadline: 1704491597648, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:07,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:07,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 136.243.18.41:56924 deadline: 1704491597648, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:08,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:08,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 136.243.18.41:56924 deadline: 1704491597648, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:09,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:09,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491597649, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:10,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:10,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491597649, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:12,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:12,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491597648, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:12,942 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10329: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:12,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:12,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491602962, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:13,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:13,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491602961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:13,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:13,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491602962, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:14,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:14,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491602962, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:15,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:15,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491602962, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:18,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:18,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491602962, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:18,257 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10323: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:18,515 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:18,515 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:18,515 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704505975144 bypass), TestNs=QuotaState(ts=1704505975144 bypass)} 2024-01-05 21:53:18,515 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704505975144 bypass), TestQuotaAdmin2=QuotaState(ts=1704505975144 bypass)} 2024-01-05 21:53:18,516 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704505975144 bypass)} 2024-01-05 21:53:18,516 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704505975144 bypass)} 2024-01-05 21:53:18,766 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:18,766 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:18,766 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704505975144 bypass), TestNs=QuotaState(ts=1704505975144 bypass)} 2024-01-05 21:53:18,767 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704505975144 bypass), TestNs:TestTable=QuotaState(ts=1704505975144 bypass), TestQuotaAdmin1=QuotaState(ts=1704505975144 bypass)} 2024-01-05 21:53:18,767 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704505975144 bypass)} 2024-01-05 21:53:18,767 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704505975144 bypass)} 2024-01-05 21:53:18,779 INFO [Listener at localhost/39519] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=289 (was 289), OpenFileDescriptor=595 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 307), ProcessCount=165 (was 165), AvailableMemoryMB=2527 (was 2393) - AvailableMemoryMB LEAK? - 2024-01-05 21:53:18,791 INFO [Listener at localhost/39519] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=289, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=165, AvailableMemoryMB=2527 2024-01-05 21:53:19,055 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:19,056 INFO [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-05 21:53:19,306 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:19,307 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704509575244 bypass), TestNs=QuotaState(ts=1704509575244 bypass)} 2024-01-05 21:53:19,308 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704509575244 bypass), TestQuotaAdmin2=QuotaState(ts=1704509575244 bypass)} 2024-01-05 21:53:19,308 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704509575244 global-limiter)} 2024-01-05 21:53:19,309 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704509575244 bypass)} 2024-01-05 21:53:19,559 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:19,559 INFO [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-05 21:53:19,810 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:19,811 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704509575344 bypass), TestNs=QuotaState(ts=1704509575344 bypass)} 2024-01-05 21:53:19,812 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704509575344 bypass), TestNs:TestTable=QuotaState(ts=1704509575344 bypass), TestQuotaAdmin1=QuotaState(ts=1704509575344 bypass)} 2024-01-05 21:53:19,812 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704509575344 global-limiter)} 2024-01-05 21:53:19,812 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704509575344 bypass)} 2024-01-05 21:53:19,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:19,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491609831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:20,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:20,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491609831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:20,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:20,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491609831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:21,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:21,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491609831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:22,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:22,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491609831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:25,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:25,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491609831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:25,124 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10309: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:25,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:25,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491615131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:25,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:25,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491615131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:25,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:25,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491615131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:26,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:26,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491615131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:27,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:27,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491615131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:30,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:30,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491615132, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-05 21:53:30,426 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10308: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:30,683 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:30,683 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:30,683 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704513175344 bypass), TestNs=QuotaState(ts=1704513175344 bypass)} 2024-01-05 21:53:30,683 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704513175344 bypass), TestQuotaAdmin2=QuotaState(ts=1704513175344 bypass)} 2024-01-05 21:53:30,683 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704513175344 bypass)} 2024-01-05 21:53:30,683 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704513175344 bypass)} 2024-01-05 21:53:30,933 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:30,934 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:30,934 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704513175344 bypass), TestNs=QuotaState(ts=1704513175344 bypass)} 2024-01-05 21:53:30,934 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704513175344 bypass), TestNs:TestTable=QuotaState(ts=1704513175344 bypass), TestQuotaAdmin1=QuotaState(ts=1704513175344 bypass)} 2024-01-05 21:53:30,934 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704513175344 bypass)} 2024-01-05 21:53:30,934 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704513175344 bypass)} 2024-01-05 21:53:30,945 INFO [Listener at localhost/39519] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=280 (was 289), OpenFileDescriptor=593 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=237 (was 261), ProcessCount=165 (was 165), AvailableMemoryMB=2527 (was 2527) 2024-01-05 21:53:30,956 INFO [Listener at localhost/39519] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=165, AvailableMemoryMB=2527 2024-01-05 21:53:31,214 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:31,215 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:31,215 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704516775344 bypass), TestNs=QuotaState(ts=1704516775344 bypass)} 2024-01-05 21:53:31,217 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704516775344 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1704516775344 bypass)} 2024-01-05 21:53:31,217 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-05 21:53:31,217 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704516775344 bypass)} 2024-01-05 21:53:31,467 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:31,469 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:31,469 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704516775344 bypass), TestNs=QuotaState(ts=1704516775344 bypass)} 2024-01-05 21:53:31,470 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704516775344 bypass), TestNs:TestTable=QuotaState(ts=1704516775344 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1704516775344 bypass)} 2024-01-05 21:53:31,470 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-05 21:53:31,470 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704516775344 bypass)} 2024-01-05 21:53:31,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:31,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 136.243.18.41:56924 deadline: 1704491621488, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:31,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:31,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 136.243.18.41:56924 deadline: 1704491621488, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:32,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:32,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 136.243.18.41:56924 deadline: 1704491621489, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:33,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:33,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 136.243.18.41:56924 deadline: 1704491621488, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:34,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:34,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 136.243.18.41:56924 deadline: 1704491621488, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:36,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:36,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 136.243.18.41:56924 deadline: 1704491621489, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:36,792 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10335: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:36,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:36,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491626793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:37,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:37,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491626794, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:37,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:37,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491626793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:38,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:38,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491626793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:39,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:39,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491626794, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:42,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:42,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 136.243.18.41:56924 deadline: 1704491626793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-05 21:53:42,099 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10327: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:42,357 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:42,357 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:42,357 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704520375344 bypass), TestNs=QuotaState(ts=1704520375344 bypass)} 2024-01-05 21:53:42,357 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704520375344 bypass), TestQuotaAdmin2=QuotaState(ts=1704520375344 bypass)} 2024-01-05 21:53:42,357 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-05 21:53:42,357 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704520375344 bypass)} 2024-01-05 21:53:42,608 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:42,608 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:42,608 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704520375344 bypass), TestNs=QuotaState(ts=1704520375344 bypass)} 2024-01-05 21:53:42,608 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704520375344 bypass), TestNs:TestTable=QuotaState(ts=1704520375344 bypass), TestQuotaAdmin1=QuotaState(ts=1704520375344 bypass)} 2024-01-05 21:53:42,608 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704520375344 bypass)} 2024-01-05 21:53:42,608 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704520375344 bypass)} 2024-01-05 21:53:42,619 INFO [Listener at localhost/39519] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280 (was 280), OpenFileDescriptor=593 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 237), ProcessCount=165 (was 165), AvailableMemoryMB=2527 (was 2527) 2024-01-05 21:53:42,630 INFO [Listener at localhost/39519] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=280, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=165, AvailableMemoryMB=2526 2024-01-05 21:53:42,892 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:42,892 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:42,893 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704523975344 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1704523975344 bypass)} 2024-01-05 21:53:42,893 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704523975344 bypass), TestQuotaAdmin2=QuotaState(ts=1704523975344 bypass)} 2024-01-05 21:53:42,893 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-05 21:53:42,893 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704523975344 bypass)} 2024-01-05 21:53:43,143 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:43,144 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:43,145 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704523975344 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1704523975344 bypass)} 2024-01-05 21:53:43,145 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704523975344 bypass), TestNs:TestTable=QuotaState(ts=1704523975344 bypass), TestQuotaAdmin1=QuotaState(ts=1704523975344 bypass)} 2024-01-05 21:53:43,145 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-05 21:53:43,145 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704523975344 bypass)} 2024-01-05 21:53:43,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:43,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491633165, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:43,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:43,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491633165, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:43,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:43,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491633164, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:44,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:44,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491633165, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:45,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:45,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491633165, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:48,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:48,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 136.243.18.41:56924 deadline: 1704491633165, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-05 21:53:48,466 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10320: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:48,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:48,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491638476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:48,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:48,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491638476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:49,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:49,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491638476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:49,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:49,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491638476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:51,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:51,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491638476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:53,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:53,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45377] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 136.243.18.41:56924 deadline: 1704491638477, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-05 21:53:53,761 ERROR [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10333: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812., hostname=jenkins-hbase17.apache.org,45377,1704491567565, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-05 21:53:54,020 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:54,020 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:54,020 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704527575344 bypass), TestNs=QuotaState(ts=1704527575344 bypass)} 2024-01-05 21:53:54,020 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704527575344 bypass), TestQuotaAdmin2=QuotaState(ts=1704527575344 bypass)} 2024-01-05 21:53:54,021 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-05 21:53:54,021 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704527575344 bypass)} 2024-01-05 21:53:54,271 INFO [Listener at localhost/39519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-05 21:53:54,271 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-05 21:53:54,271 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704527575344 bypass), TestNs=QuotaState(ts=1704527575344 bypass)} 2024-01-05 21:53:54,271 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704527575344 bypass), TestNs:TestTable=QuotaState(ts=1704527575344 bypass), TestQuotaAdmin1=QuotaState(ts=1704527575344 bypass)} 2024-01-05 21:53:54,271 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704527575344 bypass)} 2024-01-05 21:53:54,272 DEBUG [Listener at localhost/39519] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704527575344 bypass)} 2024-01-05 21:53:54,282 INFO [Listener at localhost/39519] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=265 (was 280), OpenFileDescriptor=581 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=190 (was 216), ProcessCount=165 (was 165), AvailableMemoryMB=2525 (was 2526) 2024-01-05 21:53:54,285 INFO [Listener at localhost/39519] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-01-05 21:53:54,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$11(2424): Client=jenkins//136.243.18.41 disable TestQuotaAdmin0 2024-01-05 21:53:54,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-01-05 21:53:54,302 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491634302"}]},"ts":"1704491634302"} 2024-01-05 21:53:54,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-05 21:53:54,304 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-01-05 21:53:54,305 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-01-05 21:53:54,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=2677f82028ac9f0e4fc6a9b0ce6ea812, UNASSIGN}] 2024-01-05 21:53:54,309 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=2677f82028ac9f0e4fc6a9b0ce6ea812, UNASSIGN 2024-01-05 21:53:54,311 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2677f82028ac9f0e4fc6a9b0ce6ea812, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:54,311 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491634310"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491634310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491634310"}]},"ts":"1704491634310"} 2024-01-05 21:53:54,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 2677f82028ac9f0e4fc6a9b0ce6ea812, server=jenkins-hbase17.apache.org,45377,1704491567565}] 2024-01-05 21:53:54,452 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase17.apache.org,45377,1704491567565, timeout=1704491634469, delay=17, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 2677f82028ac9f0e4fc6a9b0ce6ea812, server=jenkins-hbase17.apache.org,45377,1704491567565]] 2024-01-05 21:53:54,471 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:54,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:53:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2677f82028ac9f0e4fc6a9b0ce6ea812, disabling compactions & flushes 2024-01-05 21:53:54,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:53:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:53:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. after waiting 0 ms 2024-01-05 21:53:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:53:54,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 2677f82028ac9f0e4fc6a9b0ce6ea812 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-01-05 21:53:54,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/.tmp/cf/241cafa80f684bdab66d0eba8246d0e8 2024-01-05 21:53:54,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-05 21:53:54,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/.tmp/cf/241cafa80f684bdab66d0eba8246d0e8 as hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/cf/241cafa80f684bdab66d0eba8246d0e8 2024-01-05 21:53:54,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/cf/241cafa80f684bdab66d0eba8246d0e8, entries=6, sequenceid=21, filesize=4.7 K 2024-01-05 21:53:54,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 2677f82028ac9f0e4fc6a9b0ce6ea812 in 126ms, sequenceid=21, compaction requested=false 2024-01-05 21:53:54,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-01-05 21:53:54,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812. 2024-01-05 21:53:54,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2677f82028ac9f0e4fc6a9b0ce6ea812: 2024-01-05 21:53:54,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:53:54,614 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2677f82028ac9f0e4fc6a9b0ce6ea812, regionState=CLOSED 2024-01-05 21:53:54,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491634613"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491634613"}]},"ts":"1704491634613"} 2024-01-05 21:53:54,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-01-05 21:53:54,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 2677f82028ac9f0e4fc6a9b0ce6ea812, server=jenkins-hbase17.apache.org,45377,1704491567565 in 302 msec 2024-01-05 21:53:54,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-01-05 21:53:54,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=2677f82028ac9f0e4fc6a9b0ce6ea812, UNASSIGN in 310 msec 2024-01-05 21:53:54,620 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491634620"}]},"ts":"1704491634620"} 2024-01-05 21:53:54,622 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-01-05 21:53:54,623 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-01-05 21:53:54,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 332 msec 2024-01-05 21:53:55,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-05 21:53:55,056 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-01-05 21:53:55,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$5(2234): Client=jenkins//136.243.18.41 delete TestQuotaAdmin0 2024-01-05 21:53:55,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-05 21:53:55,072 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-05 21:53:55,074 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-05 21:53:55,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-05 21:53:55,082 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:53:55,086 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/cf, FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/recovered.edits] 2024-01-05 21:53:55,095 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/cf/241cafa80f684bdab66d0eba8246d0e8 to hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/archive/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/cf/241cafa80f684bdab66d0eba8246d0e8 2024-01-05 21:53:55,101 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/recovered.edits/24.seqid to hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/archive/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812/recovered.edits/24.seqid 2024-01-05 21:53:55,102 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin0/2677f82028ac9f0e4fc6a9b0ce6ea812 2024-01-05 21:53:55,102 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-05 21:53:55,106 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-05 21:53:55,125 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-01-05 21:53:55,128 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-01-05 21:53:55,130 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-05 21:53:55,130 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-01-05 21:53:55,130 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704491635130"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:55,133 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-05 21:53:55,133 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2677f82028ac9f0e4fc6a9b0ce6ea812, NAME => 'TestQuotaAdmin0,,1704491571413.2677f82028ac9f0e4fc6a9b0ce6ea812.', STARTKEY => '', ENDKEY => ''}] 2024-01-05 21:53:55,133 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-01-05 21:53:55,133 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1704491635133"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:55,135 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-01-05 21:53:55,137 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-05 21:53:55,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 74 msec 2024-01-05 21:53:55,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-05 21:53:55,330 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-01-05 21:53:55,331 INFO [Listener at localhost/39519] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-01-05 21:53:55,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$11(2424): Client=jenkins//136.243.18.41 disable TestQuotaAdmin1 2024-01-05 21:53:55,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-01-05 21:53:55,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-05 21:53:55,337 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491635337"}]},"ts":"1704491635337"} 2024-01-05 21:53:55,338 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-01-05 21:53:55,340 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-01-05 21:53:55,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=820bbaa5cd243dddaa67d6cd4f1bc43c, UNASSIGN}] 2024-01-05 21:53:55,342 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=820bbaa5cd243dddaa67d6cd4f1bc43c, UNASSIGN 2024-01-05 21:53:55,343 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=820bbaa5cd243dddaa67d6cd4f1bc43c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:55,344 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491635343"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491635343"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491635343"}]},"ts":"1704491635343"} 2024-01-05 21:53:55,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 820bbaa5cd243dddaa67d6cd4f1bc43c, server=jenkins-hbase17.apache.org,45377,1704491567565}] 2024-01-05 21:53:55,498 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:55,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:53:55,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 820bbaa5cd243dddaa67d6cd4f1bc43c, disabling compactions & flushes 2024-01-05 21:53:55,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:53:55,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:53:55,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. after waiting 0 ms 2024-01-05 21:53:55,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:53:55,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-05 21:53:55,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c. 2024-01-05 21:53:55,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 820bbaa5cd243dddaa67d6cd4f1bc43c: 2024-01-05 21:53:55,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:53:55,510 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=820bbaa5cd243dddaa67d6cd4f1bc43c, regionState=CLOSED 2024-01-05 21:53:55,510 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491635510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491635510"}]},"ts":"1704491635510"} 2024-01-05 21:53:55,515 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-01-05 21:53:55,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 820bbaa5cd243dddaa67d6cd4f1bc43c, server=jenkins-hbase17.apache.org,45377,1704491567565 in 166 msec 2024-01-05 21:53:55,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-01-05 21:53:55,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=820bbaa5cd243dddaa67d6cd4f1bc43c, UNASSIGN in 174 msec 2024-01-05 21:53:55,518 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491635518"}]},"ts":"1704491635518"} 2024-01-05 21:53:55,520 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-01-05 21:53:55,522 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-01-05 21:53:55,525 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 192 msec 2024-01-05 21:53:55,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-05 21:53:55,588 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-01-05 21:53:55,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$5(2234): Client=jenkins//136.243.18.41 delete TestQuotaAdmin1 2024-01-05 21:53:55,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-05 21:53:55,592 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-05 21:53:55,593 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-05 21:53:55,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-05 21:53:55,598 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:53:55,601 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c/cf, FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c/recovered.edits] 2024-01-05 21:53:55,610 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c/recovered.edits/4.seqid to hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/archive/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c/recovered.edits/4.seqid 2024-01-05 21:53:55,611 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin1/820bbaa5cd243dddaa67d6cd4f1bc43c 2024-01-05 21:53:55,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-05 21:53:55,615 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-05 21:53:55,617 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-01-05 21:53:55,619 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-01-05 21:53:55,621 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-05 21:53:55,621 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-01-05 21:53:55,621 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704491635621"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:55,623 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-05 21:53:55,623 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 820bbaa5cd243dddaa67d6cd4f1bc43c, NAME => 'TestQuotaAdmin1,,1704491572225.820bbaa5cd243dddaa67d6cd4f1bc43c.', STARTKEY => '', ENDKEY => ''}] 2024-01-05 21:53:55,623 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-01-05 21:53:55,623 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1704491635623"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:55,625 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-01-05 21:53:55,627 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-05 21:53:55,629 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 38 msec 2024-01-05 21:53:55,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-05 21:53:55,847 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-01-05 21:53:55,847 INFO [Listener at localhost/39519] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-01-05 21:53:55,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$11(2424): Client=jenkins//136.243.18.41 disable TestQuotaAdmin2 2024-01-05 21:53:55,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-01-05 21:53:55,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-05 21:53:55,853 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491635853"}]},"ts":"1704491635853"} 2024-01-05 21:53:55,855 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-01-05 21:53:55,856 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-01-05 21:53:55,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=197b3477ef59f93240e194b3dbc2bbff, UNASSIGN}] 2024-01-05 21:53:55,859 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=197b3477ef59f93240e194b3dbc2bbff, UNASSIGN 2024-01-05 21:53:55,859 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=197b3477ef59f93240e194b3dbc2bbff, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:53:55,860 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491635859"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491635859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491635859"}]},"ts":"1704491635859"} 2024-01-05 21:53:55,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 197b3477ef59f93240e194b3dbc2bbff, server=jenkins-hbase17.apache.org,40573,1704491567363}] 2024-01-05 21:53:56,014 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:53:56,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:53:56,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 197b3477ef59f93240e194b3dbc2bbff, disabling compactions & flushes 2024-01-05 21:53:56,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:53:56,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:53:56,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. after waiting 0 ms 2024-01-05 21:53:56,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:53:56,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-05 21:53:56,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff. 2024-01-05 21:53:56,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 197b3477ef59f93240e194b3dbc2bbff: 2024-01-05 21:53:56,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:53:56,027 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=197b3477ef59f93240e194b3dbc2bbff, regionState=CLOSED 2024-01-05 21:53:56,027 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704491636027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491636027"}]},"ts":"1704491636027"} 2024-01-05 21:53:56,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-01-05 21:53:56,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 197b3477ef59f93240e194b3dbc2bbff, server=jenkins-hbase17.apache.org,40573,1704491567363 in 168 msec 2024-01-05 21:53:56,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-01-05 21:53:56,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=197b3477ef59f93240e194b3dbc2bbff, UNASSIGN in 174 msec 2024-01-05 21:53:56,035 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491636035"}]},"ts":"1704491636035"} 2024-01-05 21:53:56,037 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-01-05 21:53:56,039 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-01-05 21:53:56,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 192 msec 2024-01-05 21:53:56,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-05 21:53:56,104 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-01-05 21:53:56,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$5(2234): Client=jenkins//136.243.18.41 delete TestQuotaAdmin2 2024-01-05 21:53:56,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-05 21:53:56,109 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-05 21:53:56,110 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-05 21:53:56,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-05 21:53:56,114 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:53:56,117 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff/cf, FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff/recovered.edits] 2024-01-05 21:53:56,131 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff/recovered.edits/4.seqid to hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/archive/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff/recovered.edits/4.seqid 2024-01-05 21:53:56,132 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/default/TestQuotaAdmin2/197b3477ef59f93240e194b3dbc2bbff 2024-01-05 21:53:56,132 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-05 21:53:56,135 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-05 21:53:56,138 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-01-05 21:53:56,140 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-01-05 21:53:56,142 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-05 21:53:56,142 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-01-05 21:53:56,142 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704491636142"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:56,144 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-05 21:53:56,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 197b3477ef59f93240e194b3dbc2bbff, NAME => 'TestQuotaAdmin2,,1704491573002.197b3477ef59f93240e194b3dbc2bbff.', STARTKEY => '', ENDKEY => ''}] 2024-01-05 21:53:56,144 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-01-05 21:53:56,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1704491636144"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:56,146 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-01-05 21:53:56,149 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-05 21:53:56,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 44 msec 2024-01-05 21:53:56,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-05 21:53:56,363 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-01-05 21:53:56,363 INFO [Listener at localhost/39519] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-01-05 21:53:56,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$11(2424): Client=jenkins//136.243.18.41 disable TestNs:TestTable 2024-01-05 21:53:56,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-01-05 21:53:56,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-05 21:53:56,375 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491636375"}]},"ts":"1704491636375"} 2024-01-05 21:53:56,377 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-01-05 21:53:56,378 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-01-05 21:53:56,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=5b57cd424eaa719714c6cd708a2497aa, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0f5937f77535ae9913fc69dfadd1989b, UNASSIGN}] 2024-01-05 21:53:56,381 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0f5937f77535ae9913fc69dfadd1989b, UNASSIGN 2024-01-05 21:53:56,381 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=5b57cd424eaa719714c6cd708a2497aa, UNASSIGN 2024-01-05 21:53:56,383 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=0f5937f77535ae9913fc69dfadd1989b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:56,383 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5b57cd424eaa719714c6cd708a2497aa, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:53:56,383 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491636382"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491636382"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491636382"}]},"ts":"1704491636382"} 2024-01-05 21:53:56,383 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491636382"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1704491636382"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704491636382"}]},"ts":"1704491636382"} 2024-01-05 21:53:56,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure 0f5937f77535ae9913fc69dfadd1989b, server=jenkins-hbase17.apache.org,45377,1704491567565}] 2024-01-05 21:53:56,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure 5b57cd424eaa719714c6cd708a2497aa, server=jenkins-hbase17.apache.org,40573,1704491567363}] 2024-01-05 21:53:56,537 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:56,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:53:56,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0f5937f77535ae9913fc69dfadd1989b, disabling compactions & flushes 2024-01-05 21:53:56,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:53:56,538 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:53:56,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:53:56,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. after waiting 0 ms 2024-01-05 21:53:56,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:53:56,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:53:56,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 5b57cd424eaa719714c6cd708a2497aa, disabling compactions & flushes 2024-01-05 21:53:56,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:53:56,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:53:56,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. after waiting 0 ms 2024-01-05 21:53:56,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:53:56,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-05 21:53:56,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-05 21:53:56,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa. 2024-01-05 21:53:56,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 5b57cd424eaa719714c6cd708a2497aa: 2024-01-05 21:53:56,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b. 2024-01-05 21:53:56,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0f5937f77535ae9913fc69dfadd1989b: 2024-01-05 21:53:56,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:53:56,549 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5b57cd424eaa719714c6cd708a2497aa, regionState=CLOSED 2024-01-05 21:53:56,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:53:56,549 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491636549"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491636549"}]},"ts":"1704491636549"} 2024-01-05 21:53:56,550 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=0f5937f77535ae9913fc69dfadd1989b, regionState=CLOSED 2024-01-05 21:53:56,550 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704491636550"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704491636550"}]},"ts":"1704491636550"} 2024-01-05 21:53:56,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-01-05 21:53:56,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-01-05 21:53:56,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure 5b57cd424eaa719714c6cd708a2497aa, server=jenkins-hbase17.apache.org,40573,1704491567363 in 166 msec 2024-01-05 21:53:56,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure 0f5937f77535ae9913fc69dfadd1989b, server=jenkins-hbase17.apache.org,45377,1704491567565 in 167 msec 2024-01-05 21:53:56,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=5b57cd424eaa719714c6cd708a2497aa, UNASSIGN in 173 msec 2024-01-05 21:53:56,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-01-05 21:53:56,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0f5937f77535ae9913fc69dfadd1989b, UNASSIGN in 173 msec 2024-01-05 21:53:56,556 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704491636556"}]},"ts":"1704491636556"} 2024-01-05 21:53:56,557 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-01-05 21:53:56,559 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-01-05 21:53:56,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 196 msec 2024-01-05 21:53:56,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-05 21:53:56,620 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-01-05 21:53:56,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$5(2234): Client=jenkins//136.243.18.41 delete TestNs:TestTable 2024-01-05 21:53:56,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-01-05 21:53:56,624 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-05 21:53:56,625 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-05 21:53:56,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-05 21:53:56,633 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:53:56,633 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:53:56,635 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa/cf, FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa/recovered.edits] 2024-01-05 21:53:56,635 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b/cf, FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b/recovered.edits] 2024-01-05 21:53:56,641 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa/recovered.edits/4.seqid to hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/archive/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa/recovered.edits/4.seqid 2024-01-05 21:53:56,641 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b/recovered.edits/4.seqid to hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/archive/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b/recovered.edits/4.seqid 2024-01-05 21:53:56,642 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/5b57cd424eaa719714c6cd708a2497aa 2024-01-05 21:53:56,642 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/.tmp/data/TestNs/TestTable/0f5937f77535ae9913fc69dfadd1989b 2024-01-05 21:53:56,642 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-05 21:53:56,645 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-05 21:53:56,647 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-01-05 21:53:56,649 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-01-05 21:53:56,651 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-05 21:53:56,651 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-01-05 21:53:56,651 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704491636651"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:56,651 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704491636651"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:56,654 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-01-05 21:53:56,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b57cd424eaa719714c6cd708a2497aa, NAME => 'TestNs:TestTable,,1704491574058.5b57cd424eaa719714c6cd708a2497aa.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0f5937f77535ae9913fc69dfadd1989b, NAME => 'TestNs:TestTable,1,1704491574058.0f5937f77535ae9913fc69dfadd1989b.', STARTKEY => '1', ENDKEY => ''}] 2024-01-05 21:53:56,654 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-01-05 21:53:56,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1704491636654"}]},"ts":"9223372036854775807"} 2024-01-05 21:53:56,656 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-01-05 21:53:56,659 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-05 21:53:56,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 38 msec 2024-01-05 21:53:56,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-05 21:53:56,878 INFO [Listener at localhost/39519] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-01-05 21:53:56,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.HMaster$17(3092): Client=jenkins//136.243.18.41 delete TestNs 2024-01-05 21:53:56,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-01-05 21:53:56,891 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-05 21:53:56,894 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-05 21:53:56,896 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-05 21:53:56,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-05 21:53:56,897 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-01-05 21:53:56,897 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-05 21:53:56,898 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-05 21:53:56,901 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-05 21:53:56,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-01-05 21:53:57,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43675] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-05 21:53:57,148 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-01-05 21:53:57,148 INFO [Listener at localhost/39519] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-05 21:53:57,148 DEBUG [Listener at localhost/39519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ba1fc90 to 127.0.0.1:61550 2024-01-05 21:53:57,148 DEBUG [Listener at localhost/39519] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-05 21:53:57,149 DEBUG [Listener at localhost/39519] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-01-05 21:53:57,149 DEBUG [Listener at localhost/39519] util.JVMClusterUtil(257): Found active master hash=1097692843, stopped=false 2024-01-05 21:53:57,149 DEBUG [Listener at localhost/39519] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-05 21:53:57,150 INFO [Listener at localhost/39519] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:53:57,152 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-05 21:53:57,152 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-05 21:53:57,152 INFO [Listener at localhost/39519] procedure2.ProcedureExecutor(675): Stopping 2024-01-05 21:53:57,152 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-05 21:53:57,152 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:53:57,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-05 21:53:57,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-05 21:53:57,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-05 21:53:57,153 DEBUG [Listener at localhost/39519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3760bbc6 to 127.0.0.1:61550 2024-01-05 21:53:57,153 DEBUG [Listener at localhost/39519] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-05 21:53:57,153 INFO [Listener at localhost/39519] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase17.apache.org,40573,1704491567363' ***** 2024-01-05 21:53:57,154 INFO [Listener at localhost/39519] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-05 21:53:57,154 INFO [Listener at localhost/39519] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase17.apache.org,45377,1704491567565' ***** 2024-01-05 21:53:57,154 INFO [Listener at localhost/39519] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-05 21:53:57,154 INFO [RS:0;jenkins-hbase17:40573] regionserver.HeapMemoryManager(220): Stopping 2024-01-05 21:53:57,154 INFO [RS:1;jenkins-hbase17:45377] regionserver.HeapMemoryManager(220): Stopping 2024-01-05 21:53:57,154 INFO [RS:0;jenkins-hbase17:40573] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-05 21:53:57,154 INFO [RS:1;jenkins-hbase17:45377] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-05 21:53:57,154 INFO [RS:0;jenkins-hbase17:40573] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-05 21:53:57,154 INFO [RS:1;jenkins-hbase17:45377] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-05 21:53:57,154 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-05 21:53:57,154 INFO [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1147): stopping server jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:57,154 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-05 21:53:57,154 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(3308): Received CLOSE for 3a265a5f70a83a2419ecfe391452c542 2024-01-05 21:53:57,154 INFO [RS:1;jenkins-hbase17:45377] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-05 21:53:57,154 DEBUG [RS:1;jenkins-hbase17:45377] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x217c86e1 to 127.0.0.1:61550 2024-01-05 21:53:57,154 DEBUG [RS:1;jenkins-hbase17:45377] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-05 21:53:57,155 INFO [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1173): stopping server jenkins-hbase17.apache.org,45377,1704491567565; all regions closed. 2024-01-05 21:53:57,155 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(3308): Received CLOSE for 56d13a12cc61334f95442901a786d7b4 2024-01-05 21:53:57,155 DEBUG [RS:1;jenkins-hbase17:45377] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-05 21:53:57,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 3a265a5f70a83a2419ecfe391452c542, disabling compactions & flushes 2024-01-05 21:53:57,155 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1147): stopping server jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:53:57,155 INFO [RS:0;jenkins-hbase17:40573] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-05 21:53:57,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:53:57,155 DEBUG [RS:0;jenkins-hbase17:40573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7768e20d to 127.0.0.1:61550 2024-01-05 21:53:57,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:53:57,155 DEBUG [RS:0;jenkins-hbase17:40573] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-05 21:53:57,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. after waiting 0 ms 2024-01-05 21:53:57,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:53:57,156 INFO [RS:0;jenkins-hbase17:40573] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-05 21:53:57,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 3a265a5f70a83a2419ecfe391452c542 1/1 column families, dataSize=147 B heapSize=704 B 2024-01-05 21:53:57,156 INFO [RS:0;jenkins-hbase17:40573] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-05 21:53:57,156 INFO [RS:0;jenkins-hbase17:40573] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-05 21:53:57,156 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2024-01-05 21:53:57,157 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1477): Waiting on 3 regions to close 2024-01-05 21:53:57,157 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1481): Online Regions={3a265a5f70a83a2419ecfe391452c542=hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542., 1588230740=hbase:meta,,1.1588230740, 56d13a12cc61334f95442901a786d7b4=hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4.} 2024-01-05 21:53:57,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-05 21:53:57,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-05 21:53:57,158 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-05 21:53:57,158 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-05 21:53:57,158 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-05 21:53:57,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.17 KB heapSize=25.12 KB 2024-01-05 21:53:57,159 DEBUG [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1507): Waiting on 1588230740, 3a265a5f70a83a2419ecfe391452c542, 56d13a12cc61334f95442901a786d7b4 2024-01-05 21:53:57,169 DEBUG [RS:1;jenkins-hbase17:45377] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/oldWALs 2024-01-05 21:53:57,169 INFO [RS:1;jenkins-hbase17:45377] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C45377%2C1704491567565:(num 1704491569649) 2024-01-05 21:53:57,169 DEBUG [RS:1;jenkins-hbase17:45377] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-05 21:53:57,169 INFO [RS:1;jenkins-hbase17:45377] regionserver.LeaseManager(133): Closed leases 2024-01-05 21:53:57,169 INFO [RS:1;jenkins-hbase17:45377] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-01-05 21:53:57,170 INFO [RS:1;jenkins-hbase17:45377] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-05 21:53:57,170 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-05 21:53:57,170 INFO [RS:1;jenkins-hbase17:45377] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-05 21:53:57,170 INFO [RS:1;jenkins-hbase17:45377] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-05 21:53:57,171 INFO [RS:1;jenkins-hbase17:45377] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:45377 2024-01-05 21:53:57,178 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-05 21:53:57,178 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:57,178 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-05 21:53:57,178 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,45377,1704491567565 2024-01-05 21:53:57,178 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-05 21:53:57,179 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,45377,1704491567565] 2024-01-05 21:53:57,179 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,45377,1704491567565; numProcessing=1 2024-01-05 21:53:57,180 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,45377,1704491567565 already deleted, retry=false 2024-01-05 21:53:57,180 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase17.apache.org,45377,1704491567565 expired; onlineServers=1 2024-01-05 21:53:57,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.18 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/.tmp/info/dd20dc1ca7854a48b14c943d8e5b56ae 2024-01-05 21:53:57,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542/.tmp/info/d0f453c20c424638a6fb9adf2e5cee0b 2024-01-05 21:53:57,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd20dc1ca7854a48b14c943d8e5b56ae 2024-01-05 21:53:57,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0f453c20c424638a6fb9adf2e5cee0b 2024-01-05 21:53:57,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542/.tmp/info/d0f453c20c424638a6fb9adf2e5cee0b as hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542/info/d0f453c20c424638a6fb9adf2e5cee0b 2024-01-05 21:53:57,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d0f453c20c424638a6fb9adf2e5cee0b 2024-01-05 21:53:57,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542/info/d0f453c20c424638a6fb9adf2e5cee0b, entries=3, sequenceid=8, filesize=5.0 K 2024-01-05 21:53:57,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 3a265a5f70a83a2419ecfe391452c542 in 71ms, sequenceid=8, compaction requested=false 2024-01-05 21:53:57,228 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-05 21:53:57,228 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-05 21:53:57,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/.tmp/rep_barrier/d3756eaef5494d32a9d4807e14ad8800 2024-01-05 21:53:57,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/namespace/3a265a5f70a83a2419ecfe391452c542/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-01-05 21:53:57,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:53:57,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 3a265a5f70a83a2419ecfe391452c542: 2024-01-05 21:53:57,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1704491570124.3a265a5f70a83a2419ecfe391452c542. 2024-01-05 21:53:57,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 56d13a12cc61334f95442901a786d7b4, disabling compactions & flushes 2024-01-05 21:53:57,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:53:57,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:53:57,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. after waiting 0 ms 2024-01-05 21:53:57,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:53:57,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 56d13a12cc61334f95442901a786d7b4 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-01-05 21:53:57,247 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3756eaef5494d32a9d4807e14ad8800 2024-01-05 21:53:57,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/.tmp/q/a39d1134f1f44be6b12e1288eede2329 2024-01-05 21:53:57,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/.tmp/table/4e0d57ba160e41b58e3a27d202ae8b93 2024-01-05 21:53:57,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a39d1134f1f44be6b12e1288eede2329 2024-01-05 21:53:57,282 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e0d57ba160e41b58e3a27d202ae8b93 2024-01-05 21:53:57,284 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-05 21:53:57,284 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:45377-0x100f99064610002, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-05 21:53:57,284 INFO [RS:1;jenkins-hbase17:45377] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase17.apache.org,45377,1704491567565; zookeeper connection closed. 2024-01-05 21:53:57,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/.tmp/info/dd20dc1ca7854a48b14c943d8e5b56ae as hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/info/dd20dc1ca7854a48b14c943d8e5b56ae 2024-01-05 21:53:57,290 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@428b59fb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@428b59fb 2024-01-05 21:53:57,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd20dc1ca7854a48b14c943d8e5b56ae 2024-01-05 21:53:57,300 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/info/dd20dc1ca7854a48b14c943d8e5b56ae, entries=30, sequenceid=66, filesize=8.0 K 2024-01-05 21:53:57,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/.tmp/rep_barrier/d3756eaef5494d32a9d4807e14ad8800 as hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/rep_barrier/d3756eaef5494d32a9d4807e14ad8800 2024-01-05 21:53:57,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/.tmp/u/dc9186b863904df1a156c1372bf7f2e9 2024-01-05 21:53:57,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3756eaef5494d32a9d4807e14ad8800 2024-01-05 21:53:57,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/rep_barrier/d3756eaef5494d32a9d4807e14ad8800, entries=5, sequenceid=66, filesize=5.3 K 2024-01-05 21:53:57,313 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/.tmp/table/4e0d57ba160e41b58e3a27d202ae8b93 as hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/table/4e0d57ba160e41b58e3a27d202ae8b93 2024-01-05 21:53:57,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc9186b863904df1a156c1372bf7f2e9 2024-01-05 21:53:57,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/.tmp/q/a39d1134f1f44be6b12e1288eede2329 as hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/q/a39d1134f1f44be6b12e1288eede2329 2024-01-05 21:53:57,322 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e0d57ba160e41b58e3a27d202ae8b93 2024-01-05 21:53:57,322 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/table/4e0d57ba160e41b58e3a27d202ae8b93, entries=13, sequenceid=66, filesize=5.6 K 2024-01-05 21:53:57,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.17 KB/14513, heapSize ~25.07 KB/25672, currentSize=0 B/0 for 1588230740 in 165ms, sequenceid=66, compaction requested=false 2024-01-05 21:53:57,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a39d1134f1f44be6b12e1288eede2329 2024-01-05 21:53:57,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/q/a39d1134f1f44be6b12e1288eede2329, entries=5, sequenceid=17, filesize=5.1 K 2024-01-05 21:53:57,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/.tmp/u/dc9186b863904df1a156c1372bf7f2e9 as hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/u/dc9186b863904df1a156c1372bf7f2e9 2024-01-05 21:53:57,339 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-01-05 21:53:57,340 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-05 21:53:57,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-05 21:53:57,341 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-05 21:53:57,341 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-01-05 21:53:57,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc9186b863904df1a156c1372bf7f2e9 2024-01-05 21:53:57,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/u/dc9186b863904df1a156c1372bf7f2e9, entries=4, sequenceid=17, filesize=5.0 K 2024-01-05 21:53:57,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 56d13a12cc61334f95442901a786d7b4 in 105ms, sequenceid=17, compaction requested=false 2024-01-05 21:53:57,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/data/hbase/quota/56d13a12cc61334f95442901a786d7b4/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-01-05 21:53:57,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:53:57,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 56d13a12cc61334f95442901a786d7b4: 2024-01-05 21:53:57,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1704491570846.56d13a12cc61334f95442901a786d7b4. 2024-01-05 21:53:57,359 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1173): stopping server jenkins-hbase17.apache.org,40573,1704491567363; all regions closed. 2024-01-05 21:53:57,359 DEBUG [RS:0;jenkins-hbase17:40573] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-05 21:53:57,365 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/WALs/jenkins-hbase17.apache.org,40573,1704491567363/jenkins-hbase17.apache.org%2C40573%2C1704491567363.meta.1704491569794.meta not finished, retry = 0 2024-01-05 21:53:57,468 DEBUG [RS:0;jenkins-hbase17:40573] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/oldWALs 2024-01-05 21:53:57,469 INFO [RS:0;jenkins-hbase17:40573] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C40573%2C1704491567363.meta:.meta(num 1704491569794) 2024-01-05 21:53:57,475 DEBUG [RS:0;jenkins-hbase17:40573] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/oldWALs 2024-01-05 21:53:57,475 INFO [RS:0;jenkins-hbase17:40573] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C40573%2C1704491567363:(num 1704491569661) 2024-01-05 21:53:57,475 DEBUG [RS:0;jenkins-hbase17:40573] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-05 21:53:57,476 INFO [RS:0;jenkins-hbase17:40573] regionserver.LeaseManager(133): Closed leases 2024-01-05 21:53:57,476 INFO [RS:0;jenkins-hbase17:40573] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-01-05 21:53:57,476 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-05 21:53:57,477 INFO [RS:0;jenkins-hbase17:40573] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:40573 2024-01-05 21:53:57,479 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-05 21:53:57,479 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,40573,1704491567363 2024-01-05 21:53:57,480 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,40573,1704491567363] 2024-01-05 21:53:57,480 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,40573,1704491567363; numProcessing=2 2024-01-05 21:53:57,480 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,40573,1704491567363 already deleted, retry=false 2024-01-05 21:53:57,480 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase17.apache.org,40573,1704491567363 expired; onlineServers=0 2024-01-05 21:53:57,480 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase17.apache.org,43675,1704491566307' ***** 2024-01-05 21:53:57,481 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2024-01-05 21:53:57,481 DEBUG [M:0;jenkins-hbase17:43675] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1be8be55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2024-01-05 21:53:57,481 INFO [M:0;jenkins-hbase17:43675] regionserver.HRegionServer(1147): stopping server jenkins-hbase17.apache.org,43675,1704491566307 2024-01-05 21:53:57,482 INFO [M:0;jenkins-hbase17:43675] regionserver.HRegionServer(1173): stopping server jenkins-hbase17.apache.org,43675,1704491566307; all regions closed. 2024-01-05 21:53:57,482 DEBUG [M:0;jenkins-hbase17:43675] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-05 21:53:57,482 DEBUG [M:0;jenkins-hbase17:43675] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-01-05 21:53:57,482 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-01-05 21:53:57,482 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1704491569266] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1704491569266,5,FailOnTimeoutGroup] 2024-01-05 21:53:57,482 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1704491569265] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1704491569265,5,FailOnTimeoutGroup] 2024-01-05 21:53:57,482 DEBUG [M:0;jenkins-hbase17:43675] cleaner.HFileCleaner(317): Stopping file delete threads 2024-01-05 21:53:57,482 INFO [M:0;jenkins-hbase17:43675] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-01-05 21:53:57,483 INFO [M:0;jenkins-hbase17:43675] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-01-05 21:53:57,483 INFO [M:0;jenkins-hbase17:43675] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-01-05 21:53:57,483 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-01-05 21:53:57,483 DEBUG [M:0;jenkins-hbase17:43675] master.HMaster(1517): Stopping service threads 2024-01-05 21:53:57,483 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-05 21:53:57,483 INFO [M:0;jenkins-hbase17:43675] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-01-05 21:53:57,483 ERROR [M:0;jenkins-hbase17:43675] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-01-05 21:53:57,484 INFO [M:0;jenkins-hbase17:43675] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-01-05 21:53:57,484 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-01-05 21:53:57,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-05 21:53:57,484 DEBUG [M:0;jenkins-hbase17:43675] zookeeper.ZKUtil(399): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-01-05 21:53:57,485 WARN [M:0;jenkins-hbase17:43675] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-01-05 21:53:57,485 INFO [M:0;jenkins-hbase17:43675] assignment.AssignmentManager(315): Stopping assignment manager 2024-01-05 21:53:57,485 INFO [M:0;jenkins-hbase17:43675] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-01-05 21:53:57,485 DEBUG [M:0;jenkins-hbase17:43675] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-05 21:53:57,485 INFO [M:0;jenkins-hbase17:43675] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-05 21:53:57,485 DEBUG [M:0;jenkins-hbase17:43675] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-05 21:53:57,485 DEBUG [M:0;jenkins-hbase17:43675] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-05 21:53:57,485 DEBUG [M:0;jenkins-hbase17:43675] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-05 21:53:57,486 INFO [M:0;jenkins-hbase17:43675] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.21 KB heapSize=184.98 KB 2024-01-05 21:53:57,501 INFO [M:0;jenkins-hbase17:43675] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.21 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/18e7c9f325f7445da9e793ed57ba3d86 2024-01-05 21:53:57,508 INFO [M:0;jenkins-hbase17:43675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18e7c9f325f7445da9e793ed57ba3d86 2024-01-05 21:53:57,509 DEBUG [M:0;jenkins-hbase17:43675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/18e7c9f325f7445da9e793ed57ba3d86 as hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/18e7c9f325f7445da9e793ed57ba3d86 2024-01-05 21:53:57,516 INFO [M:0;jenkins-hbase17:43675] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18e7c9f325f7445da9e793ed57ba3d86 2024-01-05 21:53:57,516 INFO [M:0;jenkins-hbase17:43675] regionserver.HStore(1080): Added hdfs://localhost:39451/user/jenkins/test-data/f96044d1-b5be-0824-7583-4858fd2bd7e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/18e7c9f325f7445da9e793ed57ba3d86, entries=45, sequenceid=376, filesize=12.0 K 2024-01-05 21:53:57,517 INFO [M:0;jenkins-hbase17:43675] regionserver.HRegion(2948): Finished flush of dataSize ~153.21 KB/156885, heapSize ~184.97 KB/189408, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=376, compaction requested=false 2024-01-05 21:53:57,518 INFO [M:0;jenkins-hbase17:43675] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-05 21:53:57,518 DEBUG [M:0;jenkins-hbase17:43675] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-05 21:53:57,522 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-05 21:53:57,523 INFO [M:0;jenkins-hbase17:43675] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-01-05 21:53:57,523 INFO [M:0;jenkins-hbase17:43675] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:43675 2024-01-05 21:53:57,524 DEBUG [M:0;jenkins-hbase17:43675] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,43675,1704491566307 already deleted, retry=false 2024-01-05 21:53:57,580 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-05 21:53:57,580 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): regionserver:40573-0x100f99064610001, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-05 21:53:57,580 INFO [RS:0;jenkins-hbase17:40573] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase17.apache.org,40573,1704491567363; zookeeper connection closed. 2024-01-05 21:53:57,581 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a4c316] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a4c316 2024-01-05 21:53:57,581 INFO [Listener at localhost/39519] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-01-05 21:53:57,626 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-05 21:53:57,626 INFO [M:0;jenkins-hbase17:43675] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase17.apache.org,43675,1704491566307; zookeeper connection closed. 2024-01-05 21:53:57,626 DEBUG [Listener at localhost/39519-EventThread] zookeeper.ZKWatcher(600): master:43675-0x100f99064610000, quorum=127.0.0.1:61550, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-05 21:53:57,628 WARN [Listener at localhost/39519] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-05 21:53:57,631 INFO [Listener at localhost/39519] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-05 21:53:57,735 WARN [BP-151646104-136.243.18.41-1704491563680 heartbeating to localhost/127.0.0.1:39451] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-05 21:53:57,735 WARN [BP-151646104-136.243.18.41-1704491563680 heartbeating to localhost/127.0.0.1:39451] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-151646104-136.243.18.41-1704491563680 (Datanode Uuid 9c772e53-b820-4458-8e8a-a0a227630c06) service to localhost/127.0.0.1:39451 2024-01-05 21:53:57,737 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/cluster_c41249bd-57d3-bc63-2b71-16992bb6765d/dfs/data/data3/current/BP-151646104-136.243.18.41-1704491563680] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-05 21:53:57,737 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/cluster_c41249bd-57d3-bc63-2b71-16992bb6765d/dfs/data/data4/current/BP-151646104-136.243.18.41-1704491563680] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-05 21:53:57,738 WARN [Listener at localhost/39519] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-05 21:53:57,740 INFO [Listener at localhost/39519] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-05 21:53:57,844 WARN [BP-151646104-136.243.18.41-1704491563680 heartbeating to localhost/127.0.0.1:39451] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-05 21:53:57,844 WARN [BP-151646104-136.243.18.41-1704491563680 heartbeating to localhost/127.0.0.1:39451] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-151646104-136.243.18.41-1704491563680 (Datanode Uuid 22d69153-d95a-48c4-86bf-ef1072c24866) service to localhost/127.0.0.1:39451 2024-01-05 21:53:57,845 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/cluster_c41249bd-57d3-bc63-2b71-16992bb6765d/dfs/data/data1/current/BP-151646104-136.243.18.41-1704491563680] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-05 21:53:57,845 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/0a284170-6d4e-a528-1e64-a001752528f1/cluster_c41249bd-57d3-bc63-2b71-16992bb6765d/dfs/data/data2/current/BP-151646104-136.243.18.41-1704491563680] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-05 21:53:57,883 INFO [Listener at localhost/39519] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-05 21:53:57,995 INFO [Listener at localhost/39519] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-01-05 21:53:58,036 INFO [Listener at localhost/39519] hbase.HBaseTestingUtility(1293): Minicluster is down