2024-01-22 00:55:24,299 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-01-22 00:55:24,513 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a 2024-01-22 00:55:24,526 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-01-22 00:55:24,527 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/cluster_6e6f0586-3649-b32f-f56a-fac4e4acd906, deleteOnExit=true 2024-01-22 00:55:24,527 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-01-22 00:55:24,527 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/test.cache.data in system properties and HBase conf 2024-01-22 00:55:24,528 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/hadoop.tmp.dir in system properties and HBase conf 2024-01-22 00:55:24,528 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/hadoop.log.dir in system properties and HBase conf 2024-01-22 00:55:24,528 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/mapreduce.cluster.local.dir in system properties and HBase conf 2024-01-22 00:55:24,529 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-01-22 00:55:24,529 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-01-22 00:55:24,636 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-01-22 00:55:25,011 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-22 00:55:25,015 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-01-22 00:55:25,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-01-22 00:55:25,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-01-22 00:55:25,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-22 00:55:25,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-01-22 00:55:25,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-01-22 00:55:25,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-22 00:55:25,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-22 00:55:25,018 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-01-22 00:55:25,018 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/nfs.dump.dir in system properties and HBase conf 2024-01-22 00:55:25,018 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/java.io.tmpdir in system properties and HBase conf 2024-01-22 00:55:25,019 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-22 00:55:25,019 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-01-22 00:55:25,019 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-01-22 00:55:25,553 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-22 00:55:25,558 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-22 00:55:25,851 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-01-22 00:55:26,013 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-01-22 00:55:26,027 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-22 00:55:26,063 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-01-22 00:55:26,095 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/java.io.tmpdir/Jetty_localhost_43543_hdfs____cs885b/webapp 2024-01-22 00:55:26,238 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43543 2024-01-22 00:55:26,248 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-22 00:55:26,249 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-22 00:55:27,222 WARN [Listener at localhost/35681] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-22 00:55:27,503 WARN [Listener at localhost/35681] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-22 00:55:27,732 WARN [Listener at localhost/35681] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-22 00:55:27,748 INFO [Listener at localhost/35681] log.Slf4jLog(67): jetty-6.1.26 2024-01-22 00:55:27,768 INFO [Listener at localhost/35681] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/java.io.tmpdir/Jetty_localhost_34457_datanode____.j22v9g/webapp 2024-01-22 00:55:27,874 INFO [Listener at localhost/35681] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34457 2024-01-22 00:55:28,174 WARN [Listener at localhost/43175] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-22 00:55:28,190 WARN [Listener at localhost/43175] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-22 00:55:28,194 WARN [Listener at localhost/43175] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-22 00:55:28,196 INFO [Listener at localhost/43175] log.Slf4jLog(67): jetty-6.1.26 2024-01-22 00:55:28,203 INFO [Listener at localhost/43175] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/java.io.tmpdir/Jetty_localhost_40993_datanode____5nsmta/webapp 2024-01-22 00:55:28,304 INFO [Listener at localhost/43175] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40993 2024-01-22 00:55:28,316 WARN [Listener at localhost/37375] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-22 00:55:28,657 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d18e137a2b45a1b: Processing first storage report for DS-7a75886d-4628-4037-9bb6-6f73d849c719 from datanode c81bf780-b4c3-4e4a-ac52-7578cdd3b5f3 2024-01-22 00:55:28,659 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d18e137a2b45a1b: from storage DS-7a75886d-4628-4037-9bb6-6f73d849c719 node DatanodeRegistration(127.0.0.1:35295, datanodeUuid=c81bf780-b4c3-4e4a-ac52-7578cdd3b5f3, infoPort=35887, infoSecurePort=0, ipcPort=43175, storageInfo=lv=-57;cid=testClusterID;nsid=193982634;c=1705884925635), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-01-22 00:55:28,659 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x199013e024cd256b: Processing first storage report for DS-81b51086-097b-4c2d-883f-490e74a4b44b from datanode 3412dabe-2f70-4bcb-be20-f625d3279f9b 2024-01-22 00:55:28,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x199013e024cd256b: from storage DS-81b51086-097b-4c2d-883f-490e74a4b44b node DatanodeRegistration(127.0.0.1:39093, datanodeUuid=3412dabe-2f70-4bcb-be20-f625d3279f9b, infoPort=34167, infoSecurePort=0, ipcPort=37375, storageInfo=lv=-57;cid=testClusterID;nsid=193982634;c=1705884925635), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-22 00:55:28,660 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8d18e137a2b45a1b: Processing first storage report for DS-44ae8c9e-1a2c-4786-b555-2e2c76be509f from datanode c81bf780-b4c3-4e4a-ac52-7578cdd3b5f3 2024-01-22 00:55:28,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8d18e137a2b45a1b: from storage DS-44ae8c9e-1a2c-4786-b555-2e2c76be509f node DatanodeRegistration(127.0.0.1:35295, datanodeUuid=c81bf780-b4c3-4e4a-ac52-7578cdd3b5f3, infoPort=35887, infoSecurePort=0, ipcPort=43175, storageInfo=lv=-57;cid=testClusterID;nsid=193982634;c=1705884925635), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-22 00:55:28,660 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x199013e024cd256b: Processing first storage report for DS-54217c8a-bfa0-4202-b6b9-101d9b2e62e0 from datanode 3412dabe-2f70-4bcb-be20-f625d3279f9b 2024-01-22 00:55:28,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x199013e024cd256b: from storage DS-54217c8a-bfa0-4202-b6b9-101d9b2e62e0 node DatanodeRegistration(127.0.0.1:39093, datanodeUuid=3412dabe-2f70-4bcb-be20-f625d3279f9b, infoPort=34167, infoSecurePort=0, ipcPort=37375, storageInfo=lv=-57;cid=testClusterID;nsid=193982634;c=1705884925635), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-22 00:55:28,716 DEBUG [Listener at localhost/37375] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a 2024-01-22 00:55:28,833 INFO [Listener at localhost/37375] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/cluster_6e6f0586-3649-b32f-f56a-fac4e4acd906/zookeeper_0, clientPort=62833, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/cluster_6e6f0586-3649-b32f-f56a-fac4e4acd906/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/cluster_6e6f0586-3649-b32f-f56a-fac4e4acd906/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-01-22 00:55:28,848 INFO [Listener at localhost/37375] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62833 2024-01-22 00:55:28,859 INFO [Listener at localhost/37375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:28,862 INFO [Listener at localhost/37375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:29,541 INFO [Listener at localhost/37375] util.FSUtils(471): Created version file at hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1 with version=8 2024-01-22 00:55:29,541 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/hbase-staging 2024-01-22 00:55:29,869 INFO [Listener at localhost/37375] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-01-22 00:55:30,326 INFO [Listener at localhost/37375] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-01-22 00:55:30,359 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,360 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,360 INFO [Listener at localhost/37375] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-22 00:55:30,360 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,360 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-22 00:55:30,508 INFO [Listener at localhost/37375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-01-22 00:55:30,580 DEBUG [Listener at localhost/37375] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-01-22 00:55:30,675 INFO [Listener at localhost/37375] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33599 2024-01-22 00:55:30,685 INFO [Listener at localhost/37375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:30,687 INFO [Listener at localhost/37375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:30,712 INFO [Listener at localhost/37375] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33599 connecting to ZooKeeper ensemble=127.0.0.1:62833 2024-01-22 00:55:30,757 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:335990x0, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-22 00:55:30,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33599-0x1014cba2f480000 connected 2024-01-22 00:55:30,794 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-22 00:55:30,795 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-22 00:55:30,798 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-22 00:55:30,806 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33599 2024-01-22 00:55:30,807 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33599 2024-01-22 00:55:30,807 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33599 2024-01-22 00:55:30,807 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33599 2024-01-22 00:55:30,808 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33599 2024-01-22 00:55:30,814 INFO [Listener at localhost/37375] master.HMaster(445): hbase.rootdir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1, hbase.cluster.distributed=false 2024-01-22 00:55:30,887 INFO [Listener at localhost/37375] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-22 00:55:30,887 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,887 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,887 INFO [Listener at localhost/37375] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-22 00:55:30,888 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,888 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-22 00:55:30,893 INFO [Listener at localhost/37375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-22 00:55:30,896 INFO [Listener at localhost/37375] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33391 2024-01-22 00:55:30,898 INFO [Listener at localhost/37375] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-22 00:55:30,905 DEBUG [Listener at localhost/37375] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-22 00:55:30,906 INFO [Listener at localhost/37375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:30,908 INFO [Listener at localhost/37375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:30,910 INFO [Listener at localhost/37375] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33391 connecting to ZooKeeper ensemble=127.0.0.1:62833 2024-01-22 00:55:30,915 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:333910x0, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-22 00:55:30,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33391-0x1014cba2f480001 connected 2024-01-22 00:55:30,916 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-22 00:55:30,918 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-22 00:55:30,919 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-22 00:55:30,920 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33391 2024-01-22 00:55:30,920 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33391 2024-01-22 00:55:30,921 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33391 2024-01-22 00:55:30,921 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33391 2024-01-22 00:55:30,921 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33391 2024-01-22 00:55:30,935 INFO [Listener at localhost/37375] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-22 00:55:30,935 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,935 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,935 INFO [Listener at localhost/37375] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-22 00:55:30,936 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-22 00:55:30,936 INFO [Listener at localhost/37375] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-22 00:55:30,936 INFO [Listener at localhost/37375] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-22 00:55:30,937 INFO [Listener at localhost/37375] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42117 2024-01-22 00:55:30,938 INFO [Listener at localhost/37375] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-22 00:55:30,939 DEBUG [Listener at localhost/37375] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-22 00:55:30,940 INFO [Listener at localhost/37375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:30,942 INFO [Listener at localhost/37375] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:30,944 INFO [Listener at localhost/37375] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42117 connecting to ZooKeeper ensemble=127.0.0.1:62833 2024-01-22 00:55:30,949 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:421170x0, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-22 00:55:30,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42117-0x1014cba2f480002 connected 2024-01-22 00:55:30,951 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-22 00:55:30,952 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-22 00:55:30,953 DEBUG [Listener at localhost/37375] zookeeper.ZKUtil(165): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-22 00:55:30,953 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42117 2024-01-22 00:55:30,953 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42117 2024-01-22 00:55:30,954 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42117 2024-01-22 00:55:30,954 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42117 2024-01-22 00:55:30,954 DEBUG [Listener at localhost/37375] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42117 2024-01-22 00:55:30,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:55:30,966 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-22 00:55:30,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:55:30,987 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-22 00:55:30,987 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-22 00:55:30,987 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-22 00:55:30,987 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:55:30,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-22 00:55:30,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-22 00:55:30,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33599,1705884929693 from backup master directory 2024-01-22 00:55:30,994 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:55:30,994 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-22 00:55:30,995 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-22 00:55:30,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:55:30,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-01-22 00:55:30,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-01-22 00:55:31,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/hbase.id with ID: 9c57c18c-4328-4fa5-ac3d-7d03f985f2e5 2024-01-22 00:55:31,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-22 00:55:31,155 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:55:31,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1dba3404 to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-22 00:55:31,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32639599, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-22 00:55:31,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-22 00:55:31,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-01-22 00:55:31,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-01-22 00:55:31,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-01-22 00:55:31,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-22 00:55:31,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-22 00:55:31,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-22 00:55:31,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store-tmp 2024-01-22 00:55:31,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:31,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-22 00:55:31,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-22 00:55:31,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-22 00:55:31,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-22 00:55:31,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-22 00:55:31,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-22 00:55:31,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-22 00:55:31,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/WALs/jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:55:31,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33599%2C1705884929693, suffix=, logDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/WALs/jenkins-hbase4.apache.org,33599,1705884929693, archiveDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/oldWALs, maxLogs=10 2024-01-22 00:55:31,452 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35295,DS-7a75886d-4628-4037-9bb6-6f73d849c719,DISK] 2024-01-22 00:55:31,452 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39093,DS-81b51086-097b-4c2d-883f-490e74a4b44b,DISK] 2024-01-22 00:55:31,460 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-01-22 00:55:31,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/WALs/jenkins-hbase4.apache.org,33599,1705884929693/jenkins-hbase4.apache.org%2C33599%2C1705884929693.1705884931401 2024-01-22 00:55:31,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39093,DS-81b51086-097b-4c2d-883f-490e74a4b44b,DISK], DatanodeInfoWithStorage[127.0.0.1:35295,DS-7a75886d-4628-4037-9bb6-6f73d849c719,DISK]] 2024-01-22 00:55:31,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-01-22 00:55:31,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:31,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-01-22 00:55:31,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-01-22 00:55:31,605 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-01-22 00:55:31,616 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-01-22 00:55:31,649 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-01-22 00:55:31,665 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:31,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-22 00:55:31,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-22 00:55:31,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-01-22 00:55:31,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:31,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62933079, jitterRate=-0.062224045395851135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-22 00:55:31,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-22 00:55:31,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-01-22 00:55:31,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-01-22 00:55:31,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-01-22 00:55:31,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-01-22 00:55:31,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-01-22 00:55:31,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 34 msec 2024-01-22 00:55:31,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-01-22 00:55:31,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-01-22 00:55:31,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-01-22 00:55:31,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-01-22 00:55:31,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-01-22 00:55:31,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-01-22 00:55:31,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-01-22 00:55:31,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-01-22 00:55:31,829 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:55:31,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-01-22 00:55:31,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-01-22 00:55:31,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-01-22 00:55:31,848 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-22 00:55:31,848 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-22 00:55:31,848 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-22 00:55:31,849 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:55:31,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,33599,1705884929693, sessionid=0x1014cba2f480000, setting cluster-up flag (Was=false) 2024-01-22 00:55:31,867 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:55:31,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-01-22 00:55:31,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:55:31,884 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:55:31,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-01-22 00:55:31,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:55:31,895 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.hbase-snapshot/.tmp 2024-01-22 00:55:31,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-01-22 00:55:31,959 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(954): ClusterId : 9c57c18c-4328-4fa5-ac3d-7d03f985f2e5 2024-01-22 00:55:31,959 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(954): ClusterId : 9c57c18c-4328-4fa5-ac3d-7d03f985f2e5 2024-01-22 00:55:31,965 DEBUG [RS:0;jenkins-hbase4:33391] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-22 00:55:31,965 DEBUG [RS:1;jenkins-hbase4:42117] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-22 00:55:31,973 DEBUG [RS:0;jenkins-hbase4:33391] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-22 00:55:31,973 DEBUG [RS:1;jenkins-hbase4:42117] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-22 00:55:31,973 DEBUG [RS:0;jenkins-hbase4:33391] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-22 00:55:31,973 DEBUG [RS:1;jenkins-hbase4:42117] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-22 00:55:31,977 DEBUG [RS:1;jenkins-hbase4:42117] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-22 00:55:31,977 DEBUG [RS:0;jenkins-hbase4:33391] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-22 00:55:31,980 DEBUG [RS:0;jenkins-hbase4:33391] zookeeper.ReadOnlyZKClient(139): Connect 0x2a458c2e to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-22 00:55:31,980 DEBUG [RS:1;jenkins-hbase4:42117] zookeeper.ReadOnlyZKClient(139): Connect 0x5161f982 to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-22 00:55:31,987 DEBUG [RS:1;jenkins-hbase4:42117] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fa60dde, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-22 00:55:31,987 DEBUG [RS:0;jenkins-hbase4:33391] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24827716, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-22 00:55:31,988 DEBUG [RS:0;jenkins-hbase4:33391] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20bde75e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-22 00:55:31,988 DEBUG [RS:1;jenkins-hbase4:42117] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b9992f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-22 00:55:32,013 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33391 2024-01-22 00:55:32,013 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42117 2024-01-22 00:55:32,018 INFO [RS:1;jenkins-hbase4:42117] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-22 00:55:32,018 INFO [RS:0;jenkins-hbase4:33391] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-22 00:55:32,019 INFO [RS:0;jenkins-hbase4:33391] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-22 00:55:32,019 INFO [RS:1;jenkins-hbase4:42117] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-22 00:55:32,019 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1025): About to register with Master. 2024-01-22 00:55:32,019 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1025): About to register with Master. 2024-01-22 00:55:32,022 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,33599,1705884929693 with isa=jenkins-hbase4.apache.org/172.31.14.131:33391, startcode=1705884930886 2024-01-22 00:55:32,022 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,33599,1705884929693 with isa=jenkins-hbase4.apache.org/172.31.14.131:42117, startcode=1705884930934 2024-01-22 00:55:32,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-01-22 00:55:32,041 DEBUG [RS:0;jenkins-hbase4:33391] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-22 00:55:32,041 DEBUG [RS:1;jenkins-hbase4:42117] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-22 00:55:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-22 00:55:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-22 00:55:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-22 00:55:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-22 00:55:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-01-22 00:55:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-22 00:55:32,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1705884962049 2024-01-22 00:55:32,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-01-22 00:55:32,057 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-01-22 00:55:32,058 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-01-22 00:55:32,064 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-22 00:55:32,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-01-22 00:55:32,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-01-22 00:55:32,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-01-22 00:55:32,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-01-22 00:55:32,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-01-22 00:55:32,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-01-22 00:55:32,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-01-22 00:55:32,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-01-22 00:55:32,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-01-22 00:55:32,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-01-22 00:55:32,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705884932086,5,FailOnTimeoutGroup] 2024-01-22 00:55:32,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705884932087,5,FailOnTimeoutGroup] 2024-01-22 00:55:32,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-01-22 00:55:32,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,110 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-22 00:55:32,111 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-22 00:55:32,112 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1 2024-01-22 00:55:32,116 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38823, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-01-22 00:55:32,116 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49363, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-01-22 00:55:32,135 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33599] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:32,138 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:32,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-22 00:55:32,144 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/info 2024-01-22 00:55:32,145 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-22 00:55:32,146 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:32,147 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-22 00:55:32,148 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33599] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:32,151 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/rep_barrier 2024-01-22 00:55:32,152 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-22 00:55:32,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:32,154 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1 2024-01-22 00:55:32,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-22 00:55:32,154 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1 2024-01-22 00:55:32,154 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:35681 2024-01-22 00:55:32,154 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:35681 2024-01-22 00:55:32,154 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-22 00:55:32,154 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-22 00:55:32,157 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/table 2024-01-22 00:55:32,157 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-22 00:55:32,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:32,160 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740 2024-01-22 00:55:32,161 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740 2024-01-22 00:55:32,165 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-22 00:55:32,166 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-22 00:55:32,167 DEBUG [RS:1;jenkins-hbase4:42117] zookeeper.ZKUtil(163): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:32,167 WARN [RS:1;jenkins-hbase4:42117] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-22 00:55:32,168 INFO [RS:1;jenkins-hbase4:42117] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-22 00:55:32,168 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1951): logDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/WALs/jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:32,168 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33391,1705884930886] 2024-01-22 00:55:32,169 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42117,1705884930934] 2024-01-22 00:55:32,171 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-22 00:55:32,171 DEBUG [RS:0;jenkins-hbase4:33391] zookeeper.ZKUtil(163): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:32,171 WARN [RS:0;jenkins-hbase4:33391] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-22 00:55:32,172 INFO [RS:0;jenkins-hbase4:33391] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-22 00:55:32,172 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1951): logDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/WALs/jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:32,178 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:32,179 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62588911, jitterRate=-0.0673525482416153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-22 00:55:32,179 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-22 00:55:32,179 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-22 00:55:32,179 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-22 00:55:32,179 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-22 00:55:32,179 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-22 00:55:32,179 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-22 00:55:32,180 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-22 00:55:32,180 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-22 00:55:32,182 DEBUG [RS:1;jenkins-hbase4:42117] zookeeper.ZKUtil(163): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:32,182 DEBUG [RS:0;jenkins-hbase4:33391] zookeeper.ZKUtil(163): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:32,182 DEBUG [RS:1;jenkins-hbase4:42117] zookeeper.ZKUtil(163): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:32,182 DEBUG [RS:0;jenkins-hbase4:33391] zookeeper.ZKUtil(163): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:32,186 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-01-22 00:55:32,186 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-01-22 00:55:32,194 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-22 00:55:32,194 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-22 00:55:32,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-01-22 00:55:32,203 INFO [RS:0;jenkins-hbase4:33391] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-22 00:55:32,203 INFO [RS:1;jenkins-hbase4:42117] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-22 00:55:32,210 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-01-22 00:55:32,213 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-01-22 00:55:32,225 INFO [RS:0;jenkins-hbase4:33391] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-22 00:55:32,225 INFO [RS:1;jenkins-hbase4:42117] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-22 00:55:32,228 INFO [RS:0;jenkins-hbase4:33391] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-22 00:55:32,228 INFO [RS:1;jenkins-hbase4:42117] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-22 00:55:32,229 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,229 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,230 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-22 00:55:32,230 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-22 00:55:32,238 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,238 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,239 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,239 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,240 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-22 00:55:32,240 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-22 00:55:32,240 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,240 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,240 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,240 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,240 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,240 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,240 DEBUG [RS:1;jenkins-hbase4:42117] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,240 DEBUG [RS:0;jenkins-hbase4:33391] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-22 00:55:32,241 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,241 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,241 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,241 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,242 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,242 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,242 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,242 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,259 INFO [RS:0;jenkins-hbase4:33391] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-22 00:55:32,259 INFO [RS:1;jenkins-hbase4:42117] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-22 00:55:32,262 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42117,1705884930934-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,262 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33391,1705884930886-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,287 INFO [RS:0;jenkins-hbase4:33391] regionserver.Replication(203): jenkins-hbase4.apache.org,33391,1705884930886 started 2024-01-22 00:55:32,287 INFO [RS:1;jenkins-hbase4:42117] regionserver.Replication(203): jenkins-hbase4.apache.org,42117,1705884930934 started 2024-01-22 00:55:32,287 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,33391,1705884930886, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33391, sessionid=0x1014cba2f480001 2024-01-22 00:55:32,287 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,42117,1705884930934, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42117, sessionid=0x1014cba2f480002 2024-01-22 00:55:32,287 DEBUG [RS:0;jenkins-hbase4:33391] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-22 00:55:32,287 DEBUG [RS:1;jenkins-hbase4:42117] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-22 00:55:32,287 DEBUG [RS:0;jenkins-hbase4:33391] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:32,288 DEBUG [RS:1;jenkins-hbase4:42117] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:32,288 DEBUG [RS:0;jenkins-hbase4:33391] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33391,1705884930886' 2024-01-22 00:55:32,288 DEBUG [RS:1;jenkins-hbase4:42117] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42117,1705884930934' 2024-01-22 00:55:32,289 DEBUG [RS:1;jenkins-hbase4:42117] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-22 00:55:32,289 DEBUG [RS:0;jenkins-hbase4:33391] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-22 00:55:32,290 DEBUG [RS:1;jenkins-hbase4:42117] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-22 00:55:32,290 DEBUG [RS:0;jenkins-hbase4:33391] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-22 00:55:32,291 DEBUG [RS:1;jenkins-hbase4:42117] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-22 00:55:32,291 DEBUG [RS:1;jenkins-hbase4:42117] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-22 00:55:32,291 DEBUG [RS:0;jenkins-hbase4:33391] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-22 00:55:32,291 DEBUG [RS:1;jenkins-hbase4:42117] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:32,291 DEBUG [RS:0;jenkins-hbase4:33391] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-22 00:55:32,291 DEBUG [RS:1;jenkins-hbase4:42117] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42117,1705884930934' 2024-01-22 00:55:32,291 DEBUG [RS:0;jenkins-hbase4:33391] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:32,292 DEBUG [RS:1;jenkins-hbase4:42117] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-22 00:55:32,292 DEBUG [RS:0;jenkins-hbase4:33391] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33391,1705884930886' 2024-01-22 00:55:32,292 DEBUG [RS:0;jenkins-hbase4:33391] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-22 00:55:32,293 DEBUG [RS:1;jenkins-hbase4:42117] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-22 00:55:32,293 DEBUG [RS:0;jenkins-hbase4:33391] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-22 00:55:32,293 DEBUG [RS:1;jenkins-hbase4:42117] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-22 00:55:32,293 DEBUG [RS:0;jenkins-hbase4:33391] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-22 00:55:32,293 INFO [RS:1;jenkins-hbase4:42117] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-22 00:55:32,293 INFO [RS:0;jenkins-hbase4:33391] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-22 00:55:32,296 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,296 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,297 DEBUG [RS:1;jenkins-hbase4:42117] zookeeper.ZKUtil(399): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-22 00:55:32,297 INFO [RS:1;jenkins-hbase4:42117] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-22 00:55:32,297 DEBUG [RS:0;jenkins-hbase4:33391] zookeeper.ZKUtil(399): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-22 00:55:32,297 INFO [RS:0;jenkins-hbase4:33391] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-22 00:55:32,297 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,297 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,297 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,297 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,365 DEBUG [jenkins-hbase4:33599] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-01-22 00:55:32,369 DEBUG [jenkins-hbase4:33599] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-22 00:55:32,375 DEBUG [jenkins-hbase4:33599] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-22 00:55:32,375 DEBUG [jenkins-hbase4:33599] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-22 00:55:32,375 DEBUG [jenkins-hbase4:33599] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-22 00:55:32,378 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42117,1705884930934, state=OPENING 2024-01-22 00:55:32,385 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-01-22 00:55:32,387 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:55:32,388 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-22 00:55:32,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42117,1705884930934}] 2024-01-22 00:55:32,410 INFO [RS:1;jenkins-hbase4:42117] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42117%2C1705884930934, suffix=, logDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/WALs/jenkins-hbase4.apache.org,42117,1705884930934, archiveDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/oldWALs, maxLogs=32 2024-01-22 00:55:32,410 INFO [RS:0;jenkins-hbase4:33391] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33391%2C1705884930886, suffix=, logDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/WALs/jenkins-hbase4.apache.org,33391,1705884930886, archiveDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/oldWALs, maxLogs=32 2024-01-22 00:55:32,456 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35295,DS-7a75886d-4628-4037-9bb6-6f73d849c719,DISK] 2024-01-22 00:55:32,456 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39093,DS-81b51086-097b-4c2d-883f-490e74a4b44b,DISK] 2024-01-22 00:55:32,458 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35295,DS-7a75886d-4628-4037-9bb6-6f73d849c719,DISK] 2024-01-22 00:55:32,459 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39093,DS-81b51086-097b-4c2d-883f-490e74a4b44b,DISK] 2024-01-22 00:55:32,464 INFO [RS:1;jenkins-hbase4:42117] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/WALs/jenkins-hbase4.apache.org,42117,1705884930934/jenkins-hbase4.apache.org%2C42117%2C1705884930934.1705884932415 2024-01-22 00:55:32,465 INFO [RS:0;jenkins-hbase4:33391] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/WALs/jenkins-hbase4.apache.org,33391,1705884930886/jenkins-hbase4.apache.org%2C33391%2C1705884930886.1705884932415 2024-01-22 00:55:32,465 DEBUG [RS:1;jenkins-hbase4:42117] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39093,DS-81b51086-097b-4c2d-883f-490e74a4b44b,DISK], DatanodeInfoWithStorage[127.0.0.1:35295,DS-7a75886d-4628-4037-9bb6-6f73d849c719,DISK]] 2024-01-22 00:55:32,467 DEBUG [RS:0;jenkins-hbase4:33391] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39093,DS-81b51086-097b-4c2d-883f-490e74a4b44b,DISK], DatanodeInfoWithStorage[127.0.0.1:35295,DS-7a75886d-4628-4037-9bb6-6f73d849c719,DISK]] 2024-01-22 00:55:32,576 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:32,579 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-22 00:55:32,583 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-22 00:55:32,598 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-01-22 00:55:32,599 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-22 00:55:32,603 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42117%2C1705884930934.meta, suffix=.meta, logDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/WALs/jenkins-hbase4.apache.org,42117,1705884930934, archiveDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/oldWALs, maxLogs=32 2024-01-22 00:55:32,624 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39093,DS-81b51086-097b-4c2d-883f-490e74a4b44b,DISK] 2024-01-22 00:55:32,625 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35295,DS-7a75886d-4628-4037-9bb6-6f73d849c719,DISK] 2024-01-22 00:55:32,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/WALs/jenkins-hbase4.apache.org,42117,1705884930934/jenkins-hbase4.apache.org%2C42117%2C1705884930934.meta.1705884932605.meta 2024-01-22 00:55:32,632 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39093,DS-81b51086-097b-4c2d-883f-490e74a4b44b,DISK], DatanodeInfoWithStorage[127.0.0.1:35295,DS-7a75886d-4628-4037-9bb6-6f73d849c719,DISK]] 2024-01-22 00:55:32,632 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-01-22 00:55:32,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-01-22 00:55:32,650 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-01-22 00:55:32,654 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-01-22 00:55:32,659 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-01-22 00:55:32,659 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:32,660 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-01-22 00:55:32,660 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-01-22 00:55:32,663 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-22 00:55:32,665 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/info 2024-01-22 00:55:32,665 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/info 2024-01-22 00:55:32,666 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-22 00:55:32,667 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:32,667 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-22 00:55:32,668 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/rep_barrier 2024-01-22 00:55:32,668 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/rep_barrier 2024-01-22 00:55:32,669 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-22 00:55:32,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:32,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-22 00:55:32,672 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/table 2024-01-22 00:55:32,672 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/table 2024-01-22 00:55:32,673 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-22 00:55:32,674 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:32,676 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740 2024-01-22 00:55:32,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740 2024-01-22 00:55:32,682 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-22 00:55:32,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-22 00:55:32,686 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59280375, jitterRate=-0.11665357649326324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-22 00:55:32,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-22 00:55:32,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1705884932569 2024-01-22 00:55:32,716 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2024-01-22 00:55:32,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-01-22 00:55:32,717 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42117,1705884930934, state=OPEN 2024-01-22 00:55:32,720 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-01-22 00:55:32,721 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-22 00:55:32,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-01-22 00:55:32,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42117,1705884930934 in 330 msec 2024-01-22 00:55:32,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-01-22 00:55:32,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 531 msec 2024-01-22 00:55:32,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 778 msec 2024-01-22 00:55:32,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1705884932735, completionTime=-1 2024-01-22 00:55:32,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-01-22 00:55:32,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-01-22 00:55:32,809 DEBUG [hconnection-0x211ae15d-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-22 00:55:32,813 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-22 00:55:32,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-01-22 00:55:32,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1705884992829 2024-01-22 00:55:32,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1705885052829 2024-01-22 00:55:32,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 92 msec 2024-01-22 00:55:32,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33599,1705884929693-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33599,1705884929693-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33599,1705884929693-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33599, period=300000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:32,868 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-01-22 00:55:32,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-01-22 00:55:32,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-22 00:55:32,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-01-22 00:55:32,897 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-01-22 00:55:32,900 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-22 00:55:32,922 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:32,924 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8 empty. 2024-01-22 00:55:32,925 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:32,925 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-01-22 00:55:32,951 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-01-22 00:55:32,953 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9941fea9cde602e11476e7ff7598d5f8, NAME => 'hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp 2024-01-22 00:55:32,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:32,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 9941fea9cde602e11476e7ff7598d5f8, disabling compactions & flushes 2024-01-22 00:55:32,968 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:55:32,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:55:32,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. after waiting 0 ms 2024-01-22 00:55:32,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:55:32,968 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:55:32,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 9941fea9cde602e11476e7ff7598d5f8: 2024-01-22 00:55:32,973 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-01-22 00:55:32,987 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705884932976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884932976"}]},"ts":"1705884932976"} 2024-01-22 00:55:33,017 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-22 00:55:33,019 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-22 00:55:33,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884933019"}]},"ts":"1705884933019"} 2024-01-22 00:55:33,028 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-01-22 00:55:33,033 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-22 00:55:33,034 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-22 00:55:33,034 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-22 00:55:33,035 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-22 00:55:33,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9941fea9cde602e11476e7ff7598d5f8, ASSIGN}] 2024-01-22 00:55:33,041 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9941fea9cde602e11476e7ff7598d5f8, ASSIGN 2024-01-22 00:55:33,044 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9941fea9cde602e11476e7ff7598d5f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33391,1705884930886; forceNewPlan=false, retain=false 2024-01-22 00:55:33,196 INFO [jenkins-hbase4:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-22 00:55:33,197 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9941fea9cde602e11476e7ff7598d5f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:33,197 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705884933197"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884933197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884933197"}]},"ts":"1705884933197"} 2024-01-22 00:55:33,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9941fea9cde602e11476e7ff7598d5f8, server=jenkins-hbase4.apache.org,33391,1705884930886}] 2024-01-22 00:55:33,357 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:33,358 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-22 00:55:33,361 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-22 00:55:33,369 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:55:33,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9941fea9cde602e11476e7ff7598d5f8, NAME => 'hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8.', STARTKEY => '', ENDKEY => ''} 2024-01-22 00:55:33,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:33,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:33,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:33,371 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:33,377 INFO [StoreOpener-9941fea9cde602e11476e7ff7598d5f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:33,380 DEBUG [StoreOpener-9941fea9cde602e11476e7ff7598d5f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8/info 2024-01-22 00:55:33,380 DEBUG [StoreOpener-9941fea9cde602e11476e7ff7598d5f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8/info 2024-01-22 00:55:33,381 INFO [StoreOpener-9941fea9cde602e11476e7ff7598d5f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9941fea9cde602e11476e7ff7598d5f8 columnFamilyName info 2024-01-22 00:55:33,382 INFO [StoreOpener-9941fea9cde602e11476e7ff7598d5f8-1] regionserver.HStore(310): Store=9941fea9cde602e11476e7ff7598d5f8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:33,383 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:33,384 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:33,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:55:33,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:33,393 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9941fea9cde602e11476e7ff7598d5f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65293889, jitterRate=-0.02704523503780365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-22 00:55:33,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9941fea9cde602e11476e7ff7598d5f8: 2024-01-22 00:55:33,395 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8., pid=6, masterSystemTime=1705884933357 2024-01-22 00:55:33,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:55:33,402 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:55:33,403 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9941fea9cde602e11476e7ff7598d5f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:33,403 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705884933403"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705884933403"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705884933403"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705884933403"}]},"ts":"1705884933403"} 2024-01-22 00:55:33,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-01-22 00:55:33,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9941fea9cde602e11476e7ff7598d5f8, server=jenkins-hbase4.apache.org,33391,1705884930886 in 206 msec 2024-01-22 00:55:33,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-01-22 00:55:33,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9941fea9cde602e11476e7ff7598d5f8, ASSIGN in 376 msec 2024-01-22 00:55:33,420 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-22 00:55:33,421 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884933420"}]},"ts":"1705884933420"} 2024-01-22 00:55:33,424 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-01-22 00:55:33,428 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-01-22 00:55:33,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 546 msec 2024-01-22 00:55:33,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-01-22 00:55:33,499 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-01-22 00:55:33,500 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:55:33,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-22 00:55:33,534 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-22 00:55:33,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-01-22 00:55:33,574 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-22 00:55:33,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2024-01-22 00:55:33,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-01-22 00:55:33,600 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-22 00:55:33,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2024-01-22 00:55:33,624 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-01-22 00:55:33,630 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-01-22 00:55:33,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.635sec 2024-01-22 00:55:33,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-01-22 00:55:33,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-22 00:55:33,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-01-22 00:55:33,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-01-22 00:55:33,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-01-22 00:55:33,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-01-22 00:55:33,642 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-22 00:55:33,645 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:33,646 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0 empty. 2024-01-22 00:55:33,649 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:33,649 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-01-22 00:55:33,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-01-22 00:55:33,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-01-22 00:55:33,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:33,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:33,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-01-22 00:55:33,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-01-22 00:55:33,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33599,1705884929693-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-01-22 00:55:33,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33599,1705884929693-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-01-22 00:55:33,667 DEBUG [Listener at localhost/37375] zookeeper.ReadOnlyZKClient(139): Connect 0x733d7e1b to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-22 00:55:33,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-01-22 00:55:33,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33599,1705884929693-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-22 00:55:33,681 DEBUG [Listener at localhost/37375] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5948d4a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-22 00:55:33,685 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-01-22 00:55:33,690 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => c15f5a3c6a149eb81c4c59731e5b91f0, NAME => 'hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp 2024-01-22 00:55:33,700 DEBUG [hconnection-0x752f7e24-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-22 00:55:33,714 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:33,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing c15f5a3c6a149eb81c4c59731e5b91f0, disabling compactions & flushes 2024-01-22 00:55:33,715 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:55:33,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:55:33,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. after waiting 0 ms 2024-01-22 00:55:33,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:55:33,715 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:55:33,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for c15f5a3c6a149eb81c4c59731e5b91f0: 2024-01-22 00:55:33,720 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-22 00:55:33,721 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-01-22 00:55:33,723 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705884933723"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884933723"}]},"ts":"1705884933723"} 2024-01-22 00:55:33,726 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-22 00:55:33,728 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-22 00:55:33,728 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884933728"}]},"ts":"1705884933728"} 2024-01-22 00:55:33,731 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-01-22 00:55:33,732 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:55:33,733 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:33,738 DEBUG [Listener at localhost/37375] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-22 00:55:33,740 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-22 00:55:33,742 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-22 00:55:33,742 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-22 00:55:33,742 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-22 00:55:33,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=c15f5a3c6a149eb81c4c59731e5b91f0, ASSIGN}] 2024-01-22 00:55:33,744 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=c15f5a3c6a149eb81c4c59731e5b91f0, ASSIGN 2024-01-22 00:55:33,746 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=c15f5a3c6a149eb81c4c59731e5b91f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42117,1705884930934; forceNewPlan=false, retain=false 2024-01-22 00:55:33,840 DEBUG [Listener at localhost/37375] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-22 00:55:33,896 INFO [jenkins-hbase4:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-22 00:55:33,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c15f5a3c6a149eb81c4c59731e5b91f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:33,898 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705884933897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884933897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884933897"}]},"ts":"1705884933897"} 2024-01-22 00:55:33,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c15f5a3c6a149eb81c4c59731e5b91f0, server=jenkins-hbase4.apache.org,42117,1705884930934}] 2024-01-22 00:55:33,942 DEBUG [Listener at localhost/37375] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-22 00:55:34,045 DEBUG [Listener at localhost/37375] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-22 00:55:34,055 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:34,060 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:55:34,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c15f5a3c6a149eb81c4c59731e5b91f0, NAME => 'hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0.', STARTKEY => '', ENDKEY => ''} 2024-01-22 00:55:34,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:34,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:34,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:34,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:34,063 INFO [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:34,065 DEBUG [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/q 2024-01-22 00:55:34,066 DEBUG [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/q 2024-01-22 00:55:34,066 INFO [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c15f5a3c6a149eb81c4c59731e5b91f0 columnFamilyName q 2024-01-22 00:55:34,067 INFO [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] regionserver.HStore(310): Store=c15f5a3c6a149eb81c4c59731e5b91f0/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:34,067 INFO [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:34,069 DEBUG [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/u 2024-01-22 00:55:34,069 DEBUG [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/u 2024-01-22 00:55:34,070 INFO [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c15f5a3c6a149eb81c4c59731e5b91f0 columnFamilyName u 2024-01-22 00:55:34,070 INFO [StoreOpener-c15f5a3c6a149eb81c4c59731e5b91f0-1] regionserver.HStore(310): Store=c15f5a3c6a149eb81c4c59731e5b91f0/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:34,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:34,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:34,076 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-01-22 00:55:34,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:55:34,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:34,082 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c15f5a3c6a149eb81c4c59731e5b91f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63499279, jitterRate=-0.05378700792789459}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-01-22 00:55:34,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c15f5a3c6a149eb81c4c59731e5b91f0: 2024-01-22 00:55:34,084 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0., pid=11, masterSystemTime=1705884934055 2024-01-22 00:55:34,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:55:34,087 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:55:34,088 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c15f5a3c6a149eb81c4c59731e5b91f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:34,088 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705884934087"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705884934087"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705884934087"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705884934087"}]},"ts":"1705884934087"} 2024-01-22 00:55:34,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-01-22 00:55:34,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c15f5a3c6a149eb81c4c59731e5b91f0, server=jenkins-hbase4.apache.org,42117,1705884930934 in 189 msec 2024-01-22 00:55:34,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-01-22 00:55:34,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=c15f5a3c6a149eb81c4c59731e5b91f0, ASSIGN in 352 msec 2024-01-22 00:55:34,098 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-22 00:55:34,099 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884934098"}]},"ts":"1705884934098"} 2024-01-22 00:55:34,101 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-01-22 00:55:34,105 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-01-22 00:55:34,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 471 msec 2024-01-22 00:55:34,159 DEBUG [Listener at localhost/37375] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-22 00:55:34,161 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-01-22 00:55:34,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-22 00:55:34,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-01-22 00:55:34,193 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-22 00:55:34,195 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-22 00:55:34,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-01-22 00:55:34,198 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,199 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54 empty. 2024-01-22 00:55:34,200 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,200 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-22 00:55:34,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-22 00:55:34,218 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-01-22 00:55:34,219 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4c1913dbfe9cb428da4b52a1cbac4b54, NAME => 'TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp 2024-01-22 00:55:34,236 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:34,236 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 4c1913dbfe9cb428da4b52a1cbac4b54, disabling compactions & flushes 2024-01-22 00:55:34,236 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:55:34,236 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:55:34,236 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. after waiting 0 ms 2024-01-22 00:55:34,236 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:55:34,236 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:55:34,236 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 4c1913dbfe9cb428da4b52a1cbac4b54: 2024-01-22 00:55:34,241 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-01-22 00:55:34,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884934243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884934243"}]},"ts":"1705884934243"} 2024-01-22 00:55:34,246 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-22 00:55:34,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-22 00:55:34,247 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884934247"}]},"ts":"1705884934247"} 2024-01-22 00:55:34,249 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-01-22 00:55:34,255 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-22 00:55:34,256 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-22 00:55:34,256 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-22 00:55:34,256 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-22 00:55:34,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=4c1913dbfe9cb428da4b52a1cbac4b54, ASSIGN}] 2024-01-22 00:55:34,258 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=4c1913dbfe9cb428da4b52a1cbac4b54, ASSIGN 2024-01-22 00:55:34,259 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=4c1913dbfe9cb428da4b52a1cbac4b54, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42117,1705884930934; forceNewPlan=false, retain=false 2024-01-22 00:55:34,409 INFO [jenkins-hbase4:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-22 00:55:34,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4c1913dbfe9cb428da4b52a1cbac4b54, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:34,410 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884934410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884934410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884934410"}]},"ts":"1705884934410"} 2024-01-22 00:55:34,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 4c1913dbfe9cb428da4b52a1cbac4b54, server=jenkins-hbase4.apache.org,42117,1705884930934}] 2024-01-22 00:55:34,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-22 00:55:34,567 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:34,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:55:34,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c1913dbfe9cb428da4b52a1cbac4b54, NAME => 'TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.', STARTKEY => '', ENDKEY => ''} 2024-01-22 00:55:34,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:34,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,576 INFO [StoreOpener-4c1913dbfe9cb428da4b52a1cbac4b54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,578 DEBUG [StoreOpener-4c1913dbfe9cb428da4b52a1cbac4b54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/cf 2024-01-22 00:55:34,578 DEBUG [StoreOpener-4c1913dbfe9cb428da4b52a1cbac4b54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/cf 2024-01-22 00:55:34,579 INFO [StoreOpener-4c1913dbfe9cb428da4b52a1cbac4b54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c1913dbfe9cb428da4b52a1cbac4b54 columnFamilyName cf 2024-01-22 00:55:34,580 INFO [StoreOpener-4c1913dbfe9cb428da4b52a1cbac4b54-1] regionserver.HStore(310): Store=4c1913dbfe9cb428da4b52a1cbac4b54/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:34,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:55:34,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:34,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c1913dbfe9cb428da4b52a1cbac4b54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65849441, jitterRate=-0.018766865134239197}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-22 00:55:34,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c1913dbfe9cb428da4b52a1cbac4b54: 2024-01-22 00:55:34,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54., pid=14, masterSystemTime=1705884934567 2024-01-22 00:55:34,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:55:34,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:55:34,596 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4c1913dbfe9cb428da4b52a1cbac4b54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:34,596 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884934596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705884934596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705884934596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705884934596"}]},"ts":"1705884934596"} 2024-01-22 00:55:34,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-01-22 00:55:34,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 4c1913dbfe9cb428da4b52a1cbac4b54, server=jenkins-hbase4.apache.org,42117,1705884930934 in 185 msec 2024-01-22 00:55:34,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-01-22 00:55:34,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=4c1913dbfe9cb428da4b52a1cbac4b54, ASSIGN in 346 msec 2024-01-22 00:55:34,607 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-22 00:55:34,608 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884934607"}]},"ts":"1705884934607"} 2024-01-22 00:55:34,610 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-01-22 00:55:34,613 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-01-22 00:55:34,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 424 msec 2024-01-22 00:55:34,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-22 00:55:34,963 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-01-22 00:55:34,964 DEBUG [Listener at localhost/37375] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-01-22 00:55:34,965 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:34,969 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-01-22 00:55:34,969 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:34,970 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-01-22 00:55:34,970 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:34,984 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-22 00:55:34,986 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-01-22 00:55:34,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-22 00:55:34,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-01-22 00:55:34,991 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-22 00:55:34,992 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-01-22 00:55:34,993 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-22 00:55:34,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-22 00:55:34,995 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:34,996 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b empty. 2024-01-22 00:55:34,997 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:34,997 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-22 00:55:35,019 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-01-22 00:55:35,020 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 04dae57a46e3e8c78de3bd318ebf625b, NAME => 'TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp 2024-01-22 00:55:35,035 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:35,035 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 04dae57a46e3e8c78de3bd318ebf625b, disabling compactions & flushes 2024-01-22 00:55:35,035 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:55:35,035 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:55:35,035 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. after waiting 0 ms 2024-01-22 00:55:35,036 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:55:35,036 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:55:35,036 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 04dae57a46e3e8c78de3bd318ebf625b: 2024-01-22 00:55:35,040 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-01-22 00:55:35,043 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884935043"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884935043"}]},"ts":"1705884935043"} 2024-01-22 00:55:35,045 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-22 00:55:35,047 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-22 00:55:35,047 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884935047"}]},"ts":"1705884935047"} 2024-01-22 00:55:35,049 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-01-22 00:55:35,055 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-22 00:55:35,056 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-22 00:55:35,057 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-22 00:55:35,057 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-22 00:55:35,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=04dae57a46e3e8c78de3bd318ebf625b, ASSIGN}] 2024-01-22 00:55:35,059 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=04dae57a46e3e8c78de3bd318ebf625b, ASSIGN 2024-01-22 00:55:35,061 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=04dae57a46e3e8c78de3bd318ebf625b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42117,1705884930934; forceNewPlan=false, retain=false 2024-01-22 00:55:35,211 INFO [jenkins-hbase4:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-22 00:55:35,212 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=04dae57a46e3e8c78de3bd318ebf625b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:35,213 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884935212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884935212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884935212"}]},"ts":"1705884935212"} 2024-01-22 00:55:35,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 04dae57a46e3e8c78de3bd318ebf625b, server=jenkins-hbase4.apache.org,42117,1705884930934}] 2024-01-22 00:55:35,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-22 00:55:35,368 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:35,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:55:35,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04dae57a46e3e8c78de3bd318ebf625b, NAME => 'TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.', STARTKEY => '', ENDKEY => ''} 2024-01-22 00:55:35,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:35,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:35,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:35,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:35,376 INFO [StoreOpener-04dae57a46e3e8c78de3bd318ebf625b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:35,378 DEBUG [StoreOpener-04dae57a46e3e8c78de3bd318ebf625b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b/cf 2024-01-22 00:55:35,378 DEBUG [StoreOpener-04dae57a46e3e8c78de3bd318ebf625b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b/cf 2024-01-22 00:55:35,379 INFO [StoreOpener-04dae57a46e3e8c78de3bd318ebf625b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04dae57a46e3e8c78de3bd318ebf625b columnFamilyName cf 2024-01-22 00:55:35,380 INFO [StoreOpener-04dae57a46e3e8c78de3bd318ebf625b-1] regionserver.HStore(310): Store=04dae57a46e3e8c78de3bd318ebf625b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:35,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:35,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:35,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:55:35,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:35,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 04dae57a46e3e8c78de3bd318ebf625b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73309590, jitterRate=0.0923980176448822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-22 00:55:35,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 04dae57a46e3e8c78de3bd318ebf625b: 2024-01-22 00:55:35,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b., pid=17, masterSystemTime=1705884935368 2024-01-22 00:55:35,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:55:35,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:55:35,399 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=04dae57a46e3e8c78de3bd318ebf625b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:35,399 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884935399"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705884935399"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705884935399"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705884935399"}]},"ts":"1705884935399"} 2024-01-22 00:55:35,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-01-22 00:55:35,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 04dae57a46e3e8c78de3bd318ebf625b, server=jenkins-hbase4.apache.org,42117,1705884930934 in 186 msec 2024-01-22 00:55:35,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-01-22 00:55:35,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=04dae57a46e3e8c78de3bd318ebf625b, ASSIGN in 347 msec 2024-01-22 00:55:35,409 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-22 00:55:35,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884935409"}]},"ts":"1705884935409"} 2024-01-22 00:55:35,411 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-01-22 00:55:35,414 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-01-22 00:55:35,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 427 msec 2024-01-22 00:55:35,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-22 00:55:35,747 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-01-22 00:55:35,748 DEBUG [Listener at localhost/37375] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-01-22 00:55:35,748 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:35,751 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-01-22 00:55:35,751 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:35,751 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-01-22 00:55:35,751 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:35,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-22 00:55:35,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-01-22 00:55:35,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-22 00:55:35,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-01-22 00:55:35,768 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-22 00:55:35,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-22 00:55:35,770 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:35,771 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd empty. 2024-01-22 00:55:35,771 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:35,771 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-22 00:55:35,792 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-01-22 00:55:35,794 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c342900f09452e82e2f06cd5b0f0bfd, NAME => 'TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp 2024-01-22 00:55:35,808 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:35,808 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 9c342900f09452e82e2f06cd5b0f0bfd, disabling compactions & flushes 2024-01-22 00:55:35,809 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:55:35,809 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:55:35,809 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. after waiting 0 ms 2024-01-22 00:55:35,809 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:55:35,809 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:55:35,809 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 9c342900f09452e82e2f06cd5b0f0bfd: 2024-01-22 00:55:35,813 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-01-22 00:55:35,815 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884935814"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884935814"}]},"ts":"1705884935814"} 2024-01-22 00:55:35,818 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-22 00:55:35,819 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-22 00:55:35,819 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884935819"}]},"ts":"1705884935819"} 2024-01-22 00:55:35,821 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-01-22 00:55:35,833 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-22 00:55:35,834 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-22 00:55:35,834 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-22 00:55:35,834 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-22 00:55:35,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9c342900f09452e82e2f06cd5b0f0bfd, ASSIGN}] 2024-01-22 00:55:35,836 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9c342900f09452e82e2f06cd5b0f0bfd, ASSIGN 2024-01-22 00:55:35,837 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9c342900f09452e82e2f06cd5b0f0bfd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33391,1705884930886; forceNewPlan=false, retain=false 2024-01-22 00:55:35,987 INFO [jenkins-hbase4:33599] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-22 00:55:35,988 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=9c342900f09452e82e2f06cd5b0f0bfd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:35,988 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884935988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884935988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884935988"}]},"ts":"1705884935988"} 2024-01-22 00:55:35,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 9c342900f09452e82e2f06cd5b0f0bfd, server=jenkins-hbase4.apache.org,33391,1705884930886}] 2024-01-22 00:55:36,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-22 00:55:36,144 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:36,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:55:36,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c342900f09452e82e2f06cd5b0f0bfd, NAME => 'TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.', STARTKEY => '', ENDKEY => ''} 2024-01-22 00:55:36,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:36,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:36,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:36,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:36,153 INFO [StoreOpener-9c342900f09452e82e2f06cd5b0f0bfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:36,155 DEBUG [StoreOpener-9c342900f09452e82e2f06cd5b0f0bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd/cf 2024-01-22 00:55:36,155 DEBUG [StoreOpener-9c342900f09452e82e2f06cd5b0f0bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd/cf 2024-01-22 00:55:36,156 INFO [StoreOpener-9c342900f09452e82e2f06cd5b0f0bfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c342900f09452e82e2f06cd5b0f0bfd columnFamilyName cf 2024-01-22 00:55:36,156 INFO [StoreOpener-9c342900f09452e82e2f06cd5b0f0bfd-1] regionserver.HStore(310): Store=9c342900f09452e82e2f06cd5b0f0bfd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:36,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:36,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:36,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:55:36,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:36,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9c342900f09452e82e2f06cd5b0f0bfd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60167549, jitterRate=-0.10343365371227264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-22 00:55:36,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9c342900f09452e82e2f06cd5b0f0bfd: 2024-01-22 00:55:36,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd., pid=20, masterSystemTime=1705884936144 2024-01-22 00:55:36,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:55:36,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:55:36,172 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=9c342900f09452e82e2f06cd5b0f0bfd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:36,172 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884936172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705884936172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705884936172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705884936172"}]},"ts":"1705884936172"} 2024-01-22 00:55:36,173 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33599] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase4.apache.org,33391,1705884930886, table=TestQuotaAdmin2, region=9c342900f09452e82e2f06cd5b0f0bfd. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2024-01-22 00:55:36,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-01-22 00:55:36,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 9c342900f09452e82e2f06cd5b0f0bfd, server=jenkins-hbase4.apache.org,33391,1705884930886 in 183 msec 2024-01-22 00:55:36,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-01-22 00:55:36,181 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9c342900f09452e82e2f06cd5b0f0bfd, ASSIGN in 344 msec 2024-01-22 00:55:36,181 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-22 00:55:36,182 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884936182"}]},"ts":"1705884936182"} 2024-01-22 00:55:36,184 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-01-22 00:55:36,187 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-01-22 00:55:36,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 424 msec 2024-01-22 00:55:36,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-22 00:55:36,522 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-01-22 00:55:36,522 DEBUG [Listener at localhost/37375] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-01-22 00:55:36,522 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:36,526 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-01-22 00:55:36,526 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:36,526 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-01-22 00:55:36,526 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:36,533 DEBUG [hconnection-0x752f7e24-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-22 00:55:36,536 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-22 00:55:36,538 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-22 00:55:36,542 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-01-22 00:55:36,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-01-22 00:55:36,547 DEBUG [hconnection-0x2a023111-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-22 00:55:36,550 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-01-22 00:55:36,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-01-22 00:55:36,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-22 00:55:36,565 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-22 00:55:36,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 21 msec 2024-01-22 00:55:36,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-22 00:55:36,811 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-22 00:55:36,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-01-22 00:55:36,815 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-01-22 00:55:36,815 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-01-22 00:55:36,816 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-22 00:55:36,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-22 00:55:36,819 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:36,819 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:36,820 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e empty. 2024-01-22 00:55:36,821 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7 empty. 2024-01-22 00:55:36,821 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:36,822 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:36,822 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-22 00:55:36,838 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-01-22 00:55:36,839 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, NAME => 'TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp 2024-01-22 00:55:36,840 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 350f6855663a6c9327fa4d311c93e5c7, NAME => 'TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp 2024-01-22 00:55:36,860 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:36,860 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 350f6855663a6c9327fa4d311c93e5c7, disabling compactions & flushes 2024-01-22 00:55:36,860 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:55:36,860 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:55:36,860 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. after waiting 0 ms 2024-01-22 00:55:36,860 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:55:36,860 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:55:36,861 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 350f6855663a6c9327fa4d311c93e5c7: 2024-01-22 00:55:36,861 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:36,861 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, disabling compactions & flushes 2024-01-22 00:55:36,861 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:55:36,861 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:55:36,861 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. after waiting 0 ms 2024-01-22 00:55:36,861 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:55:36,861 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:55:36,861 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 0bef1fefa5dfdbe7bcdeeadf5ea64d3e: 2024-01-22 00:55:36,865 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-01-22 00:55:36,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884936867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884936867"}]},"ts":"1705884936867"} 2024-01-22 00:55:36,867 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884936867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884936867"}]},"ts":"1705884936867"} 2024-01-22 00:55:36,873 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-01-22 00:55:36,874 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-22 00:55:36,875 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884936874"}]},"ts":"1705884936874"} 2024-01-22 00:55:36,876 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-01-22 00:55:36,887 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-22 00:55:36,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-22 00:55:36,889 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-22 00:55:36,889 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-22 00:55:36,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=350f6855663a6c9327fa4d311c93e5c7, ASSIGN}] 2024-01-22 00:55:36,890 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=350f6855663a6c9327fa4d311c93e5c7, ASSIGN 2024-01-22 00:55:36,891 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, ASSIGN 2024-01-22 00:55:36,892 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=350f6855663a6c9327fa4d311c93e5c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33391,1705884930886; forceNewPlan=false, retain=false 2024-01-22 00:55:36,892 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42117,1705884930934; forceNewPlan=false, retain=false 2024-01-22 00:55:37,042 INFO [jenkins-hbase4:33599] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-01-22 00:55:37,043 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:37,043 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=350f6855663a6c9327fa4d311c93e5c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:37,044 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884937043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884937043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884937043"}]},"ts":"1705884937043"} 2024-01-22 00:55:37,044 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884937043"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884937043"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884937043"}]},"ts":"1705884937043"} 2024-01-22 00:55:37,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, server=jenkins-hbase4.apache.org,42117,1705884930934}] 2024-01-22 00:55:37,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure 350f6855663a6c9327fa4d311c93e5c7, server=jenkins-hbase4.apache.org,33391,1705884930886}] 2024-01-22 00:55:37,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-22 00:55:37,201 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:37,201 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:37,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:55:37,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 350f6855663a6c9327fa4d311c93e5c7, NAME => 'TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.', STARTKEY => '1', ENDKEY => ''} 2024-01-22 00:55:37,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:37,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:55:37,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, NAME => 'TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.', STARTKEY => '', ENDKEY => '1'} 2024-01-22 00:55:37,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:37,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-22 00:55:37,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:37,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:37,211 INFO [StoreOpener-350f6855663a6c9327fa4d311c93e5c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:37,213 INFO [StoreOpener-0bef1fefa5dfdbe7bcdeeadf5ea64d3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:37,215 DEBUG [StoreOpener-0bef1fefa5dfdbe7bcdeeadf5ea64d3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e/cf 2024-01-22 00:55:37,215 DEBUG [StoreOpener-0bef1fefa5dfdbe7bcdeeadf5ea64d3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e/cf 2024-01-22 00:55:37,215 INFO [StoreOpener-0bef1fefa5dfdbe7bcdeeadf5ea64d3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bef1fefa5dfdbe7bcdeeadf5ea64d3e columnFamilyName cf 2024-01-22 00:55:37,216 INFO [StoreOpener-0bef1fefa5dfdbe7bcdeeadf5ea64d3e-1] regionserver.HStore(310): Store=0bef1fefa5dfdbe7bcdeeadf5ea64d3e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:37,218 DEBUG [StoreOpener-350f6855663a6c9327fa4d311c93e5c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7/cf 2024-01-22 00:55:37,219 DEBUG [StoreOpener-350f6855663a6c9327fa4d311c93e5c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7/cf 2024-01-22 00:55:37,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:37,220 INFO [StoreOpener-350f6855663a6c9327fa4d311c93e5c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 350f6855663a6c9327fa4d311c93e5c7 columnFamilyName cf 2024-01-22 00:55:37,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:37,221 INFO [StoreOpener-350f6855663a6c9327fa4d311c93e5c7-1] regionserver.HStore(310): Store=350f6855663a6c9327fa4d311c93e5c7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-22 00:55:37,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:37,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:37,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:55:37,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:55:37,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:37,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-22 00:55:37,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0bef1fefa5dfdbe7bcdeeadf5ea64d3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63712459, jitterRate=-0.05061037838459015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-22 00:55:37,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 350f6855663a6c9327fa4d311c93e5c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73589038, jitterRate=0.09656211733818054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-22 00:55:37,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0bef1fefa5dfdbe7bcdeeadf5ea64d3e: 2024-01-22 00:55:37,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 350f6855663a6c9327fa4d311c93e5c7: 2024-01-22 00:55:37,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7., pid=26, masterSystemTime=1705884937200 2024-01-22 00:55:37,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e., pid=25, masterSystemTime=1705884937200 2024-01-22 00:55:37,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:55:37,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:55:37,244 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=350f6855663a6c9327fa4d311c93e5c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:55:37,244 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884937243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705884937243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705884937243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705884937243"}]},"ts":"1705884937243"} 2024-01-22 00:55:37,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:55:37,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:55:37,246 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:55:37,247 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884937246"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705884937246"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705884937246"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705884937246"}]},"ts":"1705884937246"} 2024-01-22 00:55:37,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-01-22 00:55:37,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure 350f6855663a6c9327fa4d311c93e5c7, server=jenkins-hbase4.apache.org,33391,1705884930886 in 199 msec 2024-01-22 00:55:37,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-01-22 00:55:37,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, server=jenkins-hbase4.apache.org,42117,1705884930934 in 203 msec 2024-01-22 00:55:37,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=350f6855663a6c9327fa4d311c93e5c7, ASSIGN in 362 msec 2024-01-22 00:55:37,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-01-22 00:55:37,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, ASSIGN in 365 msec 2024-01-22 00:55:37,260 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-22 00:55:37,260 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884937260"}]},"ts":"1705884937260"} 2024-01-22 00:55:37,262 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-01-22 00:55:37,266 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-01-22 00:55:37,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 455 msec 2024-01-22 00:55:37,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-22 00:55:37,570 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-01-22 00:55:37,570 DEBUG [Listener at localhost/37375] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-01-22 00:55:37,570 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:37,575 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-01-22 00:55:37,575 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:37,575 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-01-22 00:55:37,575 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:37,620 INFO [Listener at localhost/37375] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=307, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=257, ProcessCount=167, AvailableMemoryMB=15899 2024-01-22 00:55:37,910 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:37,910 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:55:37,910 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705888537658 bypass), TestNs=QuotaState(ts=1705888537658 bypass)} 2024-01-22 00:55:37,910 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705888537658 bypass), TestQuotaAdmin2=QuotaState(ts=1705888537658 bypass)} 2024-01-22 00:55:37,910 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705888537658 [ TestNs:TestTable ])} 2024-01-22 00:55:37,910 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705888537658 bypass)} 2024-01-22 00:55:38,161 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:38,161 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:55:38,161 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705888537658 bypass), TestNs=QuotaState(ts=1705888537658 bypass)} 2024-01-22 00:55:38,161 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705888537658 bypass), TestNs:TestTable=QuotaState(ts=1705888537658 bypass), TestQuotaAdmin1=QuotaState(ts=1705888537658 bypass)} 2024-01-22 00:55:38,161 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705888537658 [ TestNs:TestTable ])} 2024-01-22 00:55:38,161 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705888537658 bypass)} 2024-01-22 00:55:38,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:38,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884948183, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:38,219 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-01-22 00:55:38,286 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-01-22 00:55:38,287 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-01-22 00:55:38,287 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-01-22 00:55:38,288 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-01-22 00:55:38,289 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-01-22 00:55:38,290 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-01-22 00:55:38,290 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-01-22 00:55:38,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:38,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884948184, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:38,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:38,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884948183, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:39,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:39,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884948183, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:39,863 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-22 00:55:39,863 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-01-22 00:55:39,864 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-22 00:55:39,864 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-01-22 00:55:40,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:40,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884948184, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:43,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:43,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884948183, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:43,492 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10337: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7., hostname=jenkins-hbase4.apache.org,33391,1705884930886, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:55:43,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:43,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36644 deadline: 1705884953494, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:43,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:43,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36644 deadline: 1705884953495, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:44,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:44,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36644 deadline: 1705884953494, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:45,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:45,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36644 deadline: 1705884953495, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:46,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:46,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36644 deadline: 1705884953495, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:48,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:48,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36644 deadline: 1705884953495, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:55:48,796 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10302: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7., hostname=jenkins-hbase4.apache.org,33391,1705884930886, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:55:49,058 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:49,058 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:55:49,058 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705892137658 bypass), TestNs=QuotaState(ts=1705892137658 bypass)} 2024-01-22 00:55:49,058 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705892137658 bypass), TestQuotaAdmin2=QuotaState(ts=1705892137658 bypass)} 2024-01-22 00:55:49,058 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705892137658 bypass)} 2024-01-22 00:55:49,058 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705892137658 bypass)} 2024-01-22 00:55:49,308 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:49,309 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:55:49,309 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705892137658 bypass), TestNs=QuotaState(ts=1705892137658 bypass)} 2024-01-22 00:55:49,309 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705892137658 bypass), TestNs:TestTable=QuotaState(ts=1705892137658 bypass), TestQuotaAdmin1=QuotaState(ts=1705892137658 bypass)} 2024-01-22 00:55:49,309 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705892137658 bypass)} 2024-01-22 00:55:49,309 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705892137658 bypass)} 2024-01-22 00:55:49,325 INFO [Listener at localhost/37375] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=291 (was 307), OpenFileDescriptor=601 (was 634), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 257), ProcessCount=167 (was 167), AvailableMemoryMB=17477 (was 15899) - AvailableMemoryMB LEAK? - 2024-01-22 00:55:49,338 INFO [Listener at localhost/37375] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=214, ProcessCount=167, AvailableMemoryMB=17476 2024-01-22 00:55:49,604 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:49,605 INFO [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-22 00:55:49,855 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:55:49,856 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705895737758 bypass), TestNs=QuotaState(ts=1705895737758 bypass)} 2024-01-22 00:55:49,857 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705895737758 bypass), TestQuotaAdmin2=QuotaState(ts=1705895737758 bypass)} 2024-01-22 00:55:49,857 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705895737758 [ default ])} 2024-01-22 00:55:49,857 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705895737758 bypass)} 2024-01-22 00:55:50,107 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:55:50,108 INFO [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-22 00:55:50,358 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:55:50,359 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705895737858 bypass), TestNs=QuotaState(ts=1705895737858 bypass)} 2024-01-22 00:55:50,361 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705895737858 bypass), TestNs:TestTable=QuotaState(ts=1705895737858 bypass), TestQuotaAdmin1=QuotaState(ts=1705895737858 bypass)} 2024-01-22 00:55:50,361 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705895737858 [ default ])} 2024-01-22 00:55:50,361 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705895737858 bypass)} 2024-01-22 00:55:50,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:50,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:60084 deadline: 1705884960374, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:50,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:50,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:60084 deadline: 1705884960373, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:51,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:60084 deadline: 1705884960374, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:51,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:51,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884960374, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:53,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:53,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884960374, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:55,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:55,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884960373, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-22 00:55:55,676 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10320: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54., hostname=jenkins-hbase4.apache.org,42117,1705884930934, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:55:55,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:55,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884965693, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:55,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:55,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884965693, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:56,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:56,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884965694, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:57,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:57,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884965693, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:58,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:55:58,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884965693, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:00,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884965694, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:00,999 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10348: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54., hostname=jenkins-hbase4.apache.org,42117,1705884930934, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:56:01,255 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:01,256 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:01,256 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705899337858 bypass), TestNs=QuotaState(ts=1705899337858 bypass)} 2024-01-22 00:56:01,256 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705899337858 bypass), TestQuotaAdmin2=QuotaState(ts=1705899337858 bypass)} 2024-01-22 00:56:01,256 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705899337858 bypass)} 2024-01-22 00:56:01,256 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705899337858 bypass)} 2024-01-22 00:56:01,506 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:01,506 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:01,506 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705899337858 bypass), TestNs=QuotaState(ts=1705899337858 bypass)} 2024-01-22 00:56:01,506 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705899337858 bypass), TestNs:TestTable=QuotaState(ts=1705899337858 bypass), TestQuotaAdmin1=QuotaState(ts=1705899337858 bypass)} 2024-01-22 00:56:01,506 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705899337858 bypass)} 2024-01-22 00:56:01,507 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705899337858 bypass)} 2024-01-22 00:56:01,518 INFO [Listener at localhost/37375] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291 (was 291), OpenFileDescriptor=597 (was 601), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 214), ProcessCount=165 (was 167), AvailableMemoryMB=18291 (was 17476) - AvailableMemoryMB LEAK? - 2024-01-22 00:56:01,530 INFO [Listener at localhost/37375] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=291, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=181, ProcessCount=165, AvailableMemoryMB=18291 2024-01-22 00:56:01,792 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:01,792 INFO [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-22 00:56:02,042 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:02,044 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705902937958 bypass), TestNs=QuotaState(ts=1705902937958 bypass)} 2024-01-22 00:56:02,044 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705902937958 bypass), TestQuotaAdmin2=QuotaState(ts=1705902937958 bypass)} 2024-01-22 00:56:02,044 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705902937958 global-limiter)} 2024-01-22 00:56:02,045 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705902937958 bypass)} 2024-01-22 00:56:02,295 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:02,295 INFO [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-22 00:56:02,546 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:02,547 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705902938058 bypass), TestNs=QuotaState(ts=1705902938058 bypass)} 2024-01-22 00:56:02,548 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705902938058 bypass), TestNs:TestTable=QuotaState(ts=1705902938058 bypass), TestQuotaAdmin1=QuotaState(ts=1705902938058 bypass)} 2024-01-22 00:56:02,548 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705902938058 global-limiter)} 2024-01-22 00:56:02,548 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705902938058 bypass)} 2024-01-22 00:56:02,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:02,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884972563, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:02,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:02,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884972562, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:03,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:03,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884972562, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:04,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:04,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884972563, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:05,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:05,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884972562, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:07,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:07,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884972563, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:07,864 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10322: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54., hostname=jenkins-hbase4.apache.org,42117,1705884930934, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:56:07,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:07,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884977871, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:08,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:08,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884977870, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:08,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:08,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884977871, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:09,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:09,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884977871, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:10,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:10,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884977871, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:13,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:13,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705884977870, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-22 00:56:13,177 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10349: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54., hostname=jenkins-hbase4.apache.org,42117,1705884930934, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:56:13,433 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:13,433 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:13,433 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705906538058 bypass), TestNs=QuotaState(ts=1705906538058 bypass)} 2024-01-22 00:56:13,433 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705906538058 bypass), TestQuotaAdmin2=QuotaState(ts=1705906538058 bypass)} 2024-01-22 00:56:13,433 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705906538058 bypass)} 2024-01-22 00:56:13,433 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705906538058 bypass)} 2024-01-22 00:56:13,684 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:13,684 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:13,684 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705906538058 bypass), TestNs=QuotaState(ts=1705906538058 bypass)} 2024-01-22 00:56:13,684 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705906538058 bypass), TestNs:TestTable=QuotaState(ts=1705906538058 bypass), TestQuotaAdmin1=QuotaState(ts=1705906538058 bypass)} 2024-01-22 00:56:13,684 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705906538058 bypass)} 2024-01-22 00:56:13,684 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705906538058 bypass)} 2024-01-22 00:56:13,696 INFO [Listener at localhost/37375] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=282 (was 291), OpenFileDescriptor=595 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=153 (was 181), ProcessCount=165 (was 165), AvailableMemoryMB=18290 (was 18291) 2024-01-22 00:56:13,707 INFO [Listener at localhost/37375] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=165, AvailableMemoryMB=18289 2024-01-22 00:56:13,967 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:13,967 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:13,968 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705910138058 bypass), TestNs=QuotaState(ts=1705910138058 bypass)} 2024-01-22 00:56:13,970 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705910138058 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1705910138058 bypass)} 2024-01-22 00:56:13,970 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-22 00:56:13,970 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705910138058 bypass)} 2024-01-22 00:56:14,221 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:14,222 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:14,222 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705910138058 bypass), TestNs=QuotaState(ts=1705910138058 bypass)} 2024-01-22 00:56:14,223 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705910138058 bypass), TestNs:TestTable=QuotaState(ts=1705910138058 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1705910138058 bypass)} 2024-01-22 00:56:14,223 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-22 00:56:14,223 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705910138058 bypass)} 2024-01-22 00:56:14,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:14,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36644 deadline: 1705884984240, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:14,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:14,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36644 deadline: 1705884984240, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:15,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:15,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36644 deadline: 1705884984240, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:15,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:15,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36644 deadline: 1705884984240, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:17,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:17,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36644 deadline: 1705884984240, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:19,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:19,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36644 deadline: 1705884984239, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:19,535 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10298: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7., hostname=jenkins-hbase4.apache.org,33391,1705884930886, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:56:19,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:19,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884989537, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:19,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:19,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884989537, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:20,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:20,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884989536, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:21,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:21,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884989536, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:22,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:22,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884989536, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:24,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:24,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33391] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36644 deadline: 1705884989536, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-22 00:56:24,850 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10362: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7., hostname=jenkins-hbase4.apache.org,33391,1705884930886, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:56:25,108 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:25,108 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:25,108 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705913738058 bypass), TestNs=QuotaState(ts=1705913738058 bypass)} 2024-01-22 00:56:25,108 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705913738058 bypass), TestQuotaAdmin2=QuotaState(ts=1705913738058 bypass)} 2024-01-22 00:56:25,108 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705913738058 bypass)} 2024-01-22 00:56:25,108 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705913738058 bypass)} 2024-01-22 00:56:25,359 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:25,359 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:25,359 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705913738058 bypass), TestNs=QuotaState(ts=1705913738058 bypass)} 2024-01-22 00:56:25,359 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705913738058 bypass), TestNs:TestTable=QuotaState(ts=1705913738058 bypass), TestQuotaAdmin1=QuotaState(ts=1705913738058 bypass)} 2024-01-22 00:56:25,359 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-22 00:56:25,359 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705913738058 bypass)} 2024-01-22 00:56:25,370 INFO [Listener at localhost/37375] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282 (was 282), OpenFileDescriptor=595 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=119 (was 153), ProcessCount=165 (was 165), AvailableMemoryMB=18289 (was 18289) 2024-01-22 00:56:25,382 INFO [Listener at localhost/37375] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=282, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=119, ProcessCount=165, AvailableMemoryMB=18288 2024-01-22 00:56:25,643 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:25,644 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:25,645 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705917338058 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1705917338058 bypass)} 2024-01-22 00:56:25,645 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705917338058 bypass), TestQuotaAdmin2=QuotaState(ts=1705917338058 bypass)} 2024-01-22 00:56:25,645 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-22 00:56:25,645 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705917338058 bypass)} 2024-01-22 00:56:25,895 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:25,895 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:25,896 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705917338058 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1705917338058 bypass)} 2024-01-22 00:56:25,896 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705917338058 bypass), TestNs:TestTable=QuotaState(ts=1705917338058 bypass), TestQuotaAdmin1=QuotaState(ts=1705917338058 bypass)} 2024-01-22 00:56:25,896 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-22 00:56:25,896 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705917338058 bypass)} 2024-01-22 00:56:25,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:25,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884995911, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:26,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:26,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884995910, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:26,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:26,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884995910, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:27,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:27,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884995911, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:28,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:28,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884995910, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:31,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:31,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:60084 deadline: 1705884995910, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-22 00:56:31,216 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10327: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54., hostname=jenkins-hbase4.apache.org,42117,1705884930934, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:56:31,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:31,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705885001225, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:31,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:31,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705885001225, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:31,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:31,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705885001225, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:32,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:32,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705885001225, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:34,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:34,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705885001226, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:36,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:36,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42117] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:60084 deadline: 1705885001226, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-22 00:56:36,523 ERROR [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10315: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54., hostname=jenkins-hbase4.apache.org,42117,1705884930934, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-22 00:56:36,781 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:36,781 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:36,781 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705920938058 bypass), TestNs=QuotaState(ts=1705920938058 bypass)} 2024-01-22 00:56:36,781 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705920938058 bypass), TestQuotaAdmin2=QuotaState(ts=1705920938058 bypass)} 2024-01-22 00:56:36,781 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-22 00:56:36,781 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705920938058 bypass)} 2024-01-22 00:56:37,032 INFO [Listener at localhost/37375] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-22 00:56:37,032 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-22 00:56:37,032 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705920938058 bypass), TestNs=QuotaState(ts=1705920938058 bypass)} 2024-01-22 00:56:37,032 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705920938058 bypass), TestNs:TestTable=QuotaState(ts=1705920938058 bypass), TestQuotaAdmin1=QuotaState(ts=1705920938058 bypass)} 2024-01-22 00:56:37,032 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705920938058 bypass)} 2024-01-22 00:56:37,032 DEBUG [Listener at localhost/37375] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705920938058 bypass)} 2024-01-22 00:56:37,043 INFO [Listener at localhost/37375] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 282), OpenFileDescriptor=586 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=101 (was 119), ProcessCount=165 (was 165), AvailableMemoryMB=18289 (was 18288) - AvailableMemoryMB LEAK? - 2024-01-22 00:56:37,046 INFO [Listener at localhost/37375] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-01-22 00:56:37,050 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-01-22 00:56:37,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-01-22 00:56:37,061 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884997061"}]},"ts":"1705884997061"} 2024-01-22 00:56:37,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-22 00:56:37,062 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-01-22 00:56:37,064 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-01-22 00:56:37,066 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=4c1913dbfe9cb428da4b52a1cbac4b54, UNASSIGN}] 2024-01-22 00:56:37,067 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=4c1913dbfe9cb428da4b52a1cbac4b54, UNASSIGN 2024-01-22 00:56:37,068 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=4c1913dbfe9cb428da4b52a1cbac4b54, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:37,069 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884997068"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884997068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884997068"}]},"ts":"1705884997068"} 2024-01-22 00:56:37,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 4c1913dbfe9cb428da4b52a1cbac4b54, server=jenkins-hbase4.apache.org,42117,1705884930934}] 2024-01-22 00:56:37,201 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,42117,1705884930934, timeout=1705884997226, delay=25, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 4c1913dbfe9cb428da4b52a1cbac4b54, server=jenkins-hbase4.apache.org,42117,1705884930934]] 2024-01-22 00:56:37,228 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:37,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:56:37,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c1913dbfe9cb428da4b52a1cbac4b54, disabling compactions & flushes 2024-01-22 00:56:37,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:56:37,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:56:37,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. after waiting 0 ms 2024-01-22 00:56:37,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:56:37,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4c1913dbfe9cb428da4b52a1cbac4b54 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-01-22 00:56:37,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/.tmp/cf/2651fdb062064bce897ca487e0ed23f6 2024-01-22 00:56:37,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-22 00:56:37,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/.tmp/cf/2651fdb062064bce897ca487e0ed23f6 as hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/cf/2651fdb062064bce897ca487e0ed23f6 2024-01-22 00:56:37,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/cf/2651fdb062064bce897ca487e0ed23f6, entries=6, sequenceid=21, filesize=4.7 K 2024-01-22 00:56:37,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 4c1913dbfe9cb428da4b52a1cbac4b54 in 131ms, sequenceid=21, compaction requested=false 2024-01-22 00:56:37,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-01-22 00:56:37,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54. 2024-01-22 00:56:37,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c1913dbfe9cb428da4b52a1cbac4b54: 2024-01-22 00:56:37,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:56:37,376 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=4c1913dbfe9cb428da4b52a1cbac4b54, regionState=CLOSED 2024-01-22 00:56:37,376 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884997376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884997376"}]},"ts":"1705884997376"} 2024-01-22 00:56:37,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-01-22 00:56:37,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 4c1913dbfe9cb428da4b52a1cbac4b54, server=jenkins-hbase4.apache.org,42117,1705884930934 in 307 msec 2024-01-22 00:56:37,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-01-22 00:56:37,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=4c1913dbfe9cb428da4b52a1cbac4b54, UNASSIGN in 314 msec 2024-01-22 00:56:37,383 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884997383"}]},"ts":"1705884997383"} 2024-01-22 00:56:37,385 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-01-22 00:56:37,387 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-01-22 00:56:37,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 336 msec 2024-01-22 00:56:37,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-22 00:56:37,815 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-01-22 00:56:37,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-01-22 00:56:37,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-22 00:56:37,828 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-22 00:56:37,830 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-22 00:56:37,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-22 00:56:37,837 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:56:37,841 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/cf, FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/recovered.edits] 2024-01-22 00:56:37,851 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/cf/2651fdb062064bce897ca487e0ed23f6 to hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/archive/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/cf/2651fdb062064bce897ca487e0ed23f6 2024-01-22 00:56:37,857 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/recovered.edits/24.seqid to hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/archive/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54/recovered.edits/24.seqid 2024-01-22 00:56:37,858 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin0/4c1913dbfe9cb428da4b52a1cbac4b54 2024-01-22 00:56:37,858 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-22 00:56:37,861 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-22 00:56:37,881 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-01-22 00:56:37,884 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-01-22 00:56:37,886 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-22 00:56:37,886 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-01-22 00:56:37,886 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705884997886"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:37,888 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-22 00:56:37,888 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4c1913dbfe9cb428da4b52a1cbac4b54, NAME => 'TestQuotaAdmin0,,1705884934185.4c1913dbfe9cb428da4b52a1cbac4b54.', STARTKEY => '', ENDKEY => ''}] 2024-01-22 00:56:37,888 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-01-22 00:56:37,888 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705884997888"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:37,890 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-01-22 00:56:37,893 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-22 00:56:37,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 72 msec 2024-01-22 00:56:38,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-22 00:56:38,086 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-01-22 00:56:38,086 INFO [Listener at localhost/37375] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-01-22 00:56:38,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-01-22 00:56:38,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-01-22 00:56:38,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-22 00:56:38,092 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884998092"}]},"ts":"1705884998092"} 2024-01-22 00:56:38,093 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-01-22 00:56:38,095 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-01-22 00:56:38,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=04dae57a46e3e8c78de3bd318ebf625b, UNASSIGN}] 2024-01-22 00:56:38,097 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=04dae57a46e3e8c78de3bd318ebf625b, UNASSIGN 2024-01-22 00:56:38,098 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=04dae57a46e3e8c78de3bd318ebf625b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:38,098 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884998098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884998098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884998098"}]},"ts":"1705884998098"} 2024-01-22 00:56:38,100 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 04dae57a46e3e8c78de3bd318ebf625b, server=jenkins-hbase4.apache.org,42117,1705884930934}] 2024-01-22 00:56:38,252 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:38,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:56:38,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 04dae57a46e3e8c78de3bd318ebf625b, disabling compactions & flushes 2024-01-22 00:56:38,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:56:38,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:56:38,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. after waiting 0 ms 2024-01-22 00:56:38,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:56:38,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-22 00:56:38,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b. 2024-01-22 00:56:38,260 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 04dae57a46e3e8c78de3bd318ebf625b: 2024-01-22 00:56:38,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:56:38,262 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=04dae57a46e3e8c78de3bd318ebf625b, regionState=CLOSED 2024-01-22 00:56:38,262 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884998262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884998262"}]},"ts":"1705884998262"} 2024-01-22 00:56:38,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-01-22 00:56:38,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 04dae57a46e3e8c78de3bd318ebf625b, server=jenkins-hbase4.apache.org,42117,1705884930934 in 164 msec 2024-01-22 00:56:38,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-01-22 00:56:38,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=04dae57a46e3e8c78de3bd318ebf625b, UNASSIGN in 170 msec 2024-01-22 00:56:38,269 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884998269"}]},"ts":"1705884998269"} 2024-01-22 00:56:38,270 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-01-22 00:56:38,272 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-01-22 00:56:38,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 186 msec 2024-01-22 00:56:38,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-22 00:56:38,343 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-01-22 00:56:38,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-01-22 00:56:38,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-22 00:56:38,347 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-22 00:56:38,348 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-22 00:56:38,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-22 00:56:38,352 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:56:38,354 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b/cf, FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b/recovered.edits] 2024-01-22 00:56:38,363 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b/recovered.edits/4.seqid to hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/archive/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b/recovered.edits/4.seqid 2024-01-22 00:56:38,363 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin1/04dae57a46e3e8c78de3bd318ebf625b 2024-01-22 00:56:38,363 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-22 00:56:38,367 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-22 00:56:38,369 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-01-22 00:56:38,371 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-01-22 00:56:38,372 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-22 00:56:38,372 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-01-22 00:56:38,373 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705884998372"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:38,374 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-22 00:56:38,374 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 04dae57a46e3e8c78de3bd318ebf625b, NAME => 'TestQuotaAdmin1,,1705884934986.04dae57a46e3e8c78de3bd318ebf625b.', STARTKEY => '', ENDKEY => ''}] 2024-01-22 00:56:38,374 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-01-22 00:56:38,375 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705884998374"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:38,376 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-01-22 00:56:38,378 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-22 00:56:38,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 35 msec 2024-01-22 00:56:38,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-22 00:56:38,601 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-01-22 00:56:38,602 INFO [Listener at localhost/37375] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-01-22 00:56:38,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-01-22 00:56:38,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-01-22 00:56:38,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-22 00:56:38,607 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884998607"}]},"ts":"1705884998607"} 2024-01-22 00:56:38,608 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-01-22 00:56:38,611 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-01-22 00:56:38,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9c342900f09452e82e2f06cd5b0f0bfd, UNASSIGN}] 2024-01-22 00:56:38,613 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9c342900f09452e82e2f06cd5b0f0bfd, UNASSIGN 2024-01-22 00:56:38,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9c342900f09452e82e2f06cd5b0f0bfd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:56:38,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884998614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884998614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884998614"}]},"ts":"1705884998614"} 2024-01-22 00:56:38,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 9c342900f09452e82e2f06cd5b0f0bfd, server=jenkins-hbase4.apache.org,33391,1705884930886}] 2024-01-22 00:56:38,767 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:56:38,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:56:38,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9c342900f09452e82e2f06cd5b0f0bfd, disabling compactions & flushes 2024-01-22 00:56:38,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:56:38,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:56:38,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. after waiting 0 ms 2024-01-22 00:56:38,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:56:38,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-22 00:56:38,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd. 2024-01-22 00:56:38,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9c342900f09452e82e2f06cd5b0f0bfd: 2024-01-22 00:56:38,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:56:38,780 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9c342900f09452e82e2f06cd5b0f0bfd, regionState=CLOSED 2024-01-22 00:56:38,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705884998780"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884998780"}]},"ts":"1705884998780"} 2024-01-22 00:56:38,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-01-22 00:56:38,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 9c342900f09452e82e2f06cd5b0f0bfd, server=jenkins-hbase4.apache.org,33391,1705884930886 in 167 msec 2024-01-22 00:56:38,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-01-22 00:56:38,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9c342900f09452e82e2f06cd5b0f0bfd, UNASSIGN in 172 msec 2024-01-22 00:56:38,787 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884998787"}]},"ts":"1705884998787"} 2024-01-22 00:56:38,788 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-01-22 00:56:38,791 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-01-22 00:56:38,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 190 msec 2024-01-22 00:56:38,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-22 00:56:38,858 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-01-22 00:56:38,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-01-22 00:56:38,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-22 00:56:38,863 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-22 00:56:38,864 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-22 00:56:38,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-22 00:56:38,869 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:56:38,871 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd/cf, FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd/recovered.edits] 2024-01-22 00:56:38,880 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd/recovered.edits/4.seqid to hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/archive/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd/recovered.edits/4.seqid 2024-01-22 00:56:38,880 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/default/TestQuotaAdmin2/9c342900f09452e82e2f06cd5b0f0bfd 2024-01-22 00:56:38,881 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-22 00:56:38,884 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-22 00:56:38,886 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-01-22 00:56:38,888 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-01-22 00:56:38,890 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-22 00:56:38,890 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-01-22 00:56:38,890 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705884998890"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:38,892 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-22 00:56:38,892 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c342900f09452e82e2f06cd5b0f0bfd, NAME => 'TestQuotaAdmin2,,1705884935762.9c342900f09452e82e2f06cd5b0f0bfd.', STARTKEY => '', ENDKEY => ''}] 2024-01-22 00:56:38,892 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-01-22 00:56:38,892 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705884998892"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:38,894 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-01-22 00:56:38,896 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-22 00:56:38,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 38 msec 2024-01-22 00:56:39,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-22 00:56:39,118 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-01-22 00:56:39,118 INFO [Listener at localhost/37375] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-01-22 00:56:39,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-01-22 00:56:39,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-01-22 00:56:39,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-22 00:56:39,123 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884999123"}]},"ts":"1705884999123"} 2024-01-22 00:56:39,125 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-01-22 00:56:39,127 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-01-22 00:56:39,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=350f6855663a6c9327fa4d311c93e5c7, UNASSIGN}] 2024-01-22 00:56:39,129 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, UNASSIGN 2024-01-22 00:56:39,129 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=350f6855663a6c9327fa4d311c93e5c7, UNASSIGN 2024-01-22 00:56:39,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:39,130 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=350f6855663a6c9327fa4d311c93e5c7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:56:39,130 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884999130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884999130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884999130"}]},"ts":"1705884999130"} 2024-01-22 00:56:39,130 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884999130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705884999130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705884999130"}]},"ts":"1705884999130"} 2024-01-22 00:56:39,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure 350f6855663a6c9327fa4d311c93e5c7, server=jenkins-hbase4.apache.org,33391,1705884930886}] 2024-01-22 00:56:39,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, server=jenkins-hbase4.apache.org,42117,1705884930934}] 2024-01-22 00:56:39,284 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:56:39,284 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:39,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:56:39,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:56:39,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, disabling compactions & flushes 2024-01-22 00:56:39,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 350f6855663a6c9327fa4d311c93e5c7, disabling compactions & flushes 2024-01-22 00:56:39,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:56:39,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:56:39,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:56:39,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:56:39,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. after waiting 0 ms 2024-01-22 00:56:39,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:56:39,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. after waiting 0 ms 2024-01-22 00:56:39,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:56:39,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-22 00:56:39,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-22 00:56:39,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7. 2024-01-22 00:56:39,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 350f6855663a6c9327fa4d311c93e5c7: 2024-01-22 00:56:39,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e. 2024-01-22 00:56:39,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0bef1fefa5dfdbe7bcdeeadf5ea64d3e: 2024-01-22 00:56:39,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:56:39,296 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=350f6855663a6c9327fa4d311c93e5c7, regionState=CLOSED 2024-01-22 00:56:39,296 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884999296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884999296"}]},"ts":"1705884999296"} 2024-01-22 00:56:39,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:56:39,297 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, regionState=CLOSED 2024-01-22 00:56:39,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705884999297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705884999297"}]},"ts":"1705884999297"} 2024-01-22 00:56:39,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-01-22 00:56:39,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure 350f6855663a6c9327fa4d311c93e5c7, server=jenkins-hbase4.apache.org,33391,1705884930886 in 166 msec 2024-01-22 00:56:39,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-01-22 00:56:39,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, server=jenkins-hbase4.apache.org,42117,1705884930934 in 166 msec 2024-01-22 00:56:39,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=350f6855663a6c9327fa4d311c93e5c7, UNASSIGN in 171 msec 2024-01-22 00:56:39,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-01-22 00:56:39,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0bef1fefa5dfdbe7bcdeeadf5ea64d3e, UNASSIGN in 173 msec 2024-01-22 00:56:39,303 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705884999303"}]},"ts":"1705884999303"} 2024-01-22 00:56:39,305 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-01-22 00:56:39,308 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-01-22 00:56:39,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 190 msec 2024-01-22 00:56:39,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-22 00:56:39,374 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-01-22 00:56:39,375 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-01-22 00:56:39,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-01-22 00:56:39,378 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-22 00:56:39,379 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-22 00:56:39,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-22 00:56:39,385 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:56:39,385 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:56:39,388 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e/cf, FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e/recovered.edits] 2024-01-22 00:56:39,388 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7/cf, FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7/recovered.edits] 2024-01-22 00:56:39,396 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e/recovered.edits/4.seqid to hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/archive/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e/recovered.edits/4.seqid 2024-01-22 00:56:39,396 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7/recovered.edits/4.seqid to hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/archive/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7/recovered.edits/4.seqid 2024-01-22 00:56:39,397 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/0bef1fefa5dfdbe7bcdeeadf5ea64d3e 2024-01-22 00:56:39,397 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/.tmp/data/TestNs/TestTable/350f6855663a6c9327fa4d311c93e5c7 2024-01-22 00:56:39,397 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-22 00:56:39,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-22 00:56:39,404 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-01-22 00:56:39,406 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-01-22 00:56:39,408 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-22 00:56:39,408 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-01-22 00:56:39,408 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705884999408"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:39,408 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705884999408"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:39,410 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-01-22 00:56:39,410 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0bef1fefa5dfdbe7bcdeeadf5ea64d3e, NAME => 'TestNs:TestTable,,1705884936811.0bef1fefa5dfdbe7bcdeeadf5ea64d3e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 350f6855663a6c9327fa4d311c93e5c7, NAME => 'TestNs:TestTable,1,1705884936811.350f6855663a6c9327fa4d311c93e5c7.', STARTKEY => '1', ENDKEY => ''}] 2024-01-22 00:56:39,410 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-01-22 00:56:39,410 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705884999410"}]},"ts":"9223372036854775807"} 2024-01-22 00:56:39,412 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-01-22 00:56:39,416 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-22 00:56:39,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 41 msec 2024-01-22 00:56:39,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-22 00:56:39,633 INFO [Listener at localhost/37375] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-01-22 00:56:39,637 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-01-22 00:56:39,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-01-22 00:56:39,646 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-22 00:56:39,649 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-22 00:56:39,651 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-22 00:56:39,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-22 00:56:39,653 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-01-22 00:56:39,653 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-22 00:56:39,653 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-22 00:56:39,656 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-22 00:56:39,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-01-22 00:56:39,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33599] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-22 00:56:39,903 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-01-22 00:56:39,903 INFO [Listener at localhost/37375] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-22 00:56:39,903 DEBUG [Listener at localhost/37375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x733d7e1b to 127.0.0.1:62833 2024-01-22 00:56:39,904 DEBUG [Listener at localhost/37375] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-22 00:56:39,904 DEBUG [Listener at localhost/37375] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-01-22 00:56:39,904 DEBUG [Listener at localhost/37375] util.JVMClusterUtil(257): Found active master hash=1140844088, stopped=false 2024-01-22 00:56:39,905 DEBUG [Listener at localhost/37375] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-22 00:56:39,905 INFO [Listener at localhost/37375] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:56:39,907 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-22 00:56:39,907 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-22 00:56:39,907 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:56:39,907 INFO [Listener at localhost/37375] procedure2.ProcedureExecutor(675): Stopping 2024-01-22 00:56:39,907 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-22 00:56:39,908 DEBUG [Listener at localhost/37375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dba3404 to 127.0.0.1:62833 2024-01-22 00:56:39,908 DEBUG [Listener at localhost/37375] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-22 00:56:39,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-22 00:56:39,908 INFO [Listener at localhost/37375] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,33391,1705884930886' ***** 2024-01-22 00:56:39,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-22 00:56:39,908 INFO [Listener at localhost/37375] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-22 00:56:39,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-22 00:56:39,909 INFO [Listener at localhost/37375] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,42117,1705884930934' ***** 2024-01-22 00:56:39,909 INFO [RS:0;jenkins-hbase4:33391] regionserver.HeapMemoryManager(220): Stopping 2024-01-22 00:56:39,909 INFO [Listener at localhost/37375] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-22 00:56:39,909 INFO [RS:0;jenkins-hbase4:33391] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-22 00:56:39,909 INFO [RS:0;jenkins-hbase4:33391] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-22 00:56:39,909 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(3308): Received CLOSE for 9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:56:39,909 INFO [RS:1;jenkins-hbase4:42117] regionserver.HeapMemoryManager(220): Stopping 2024-01-22 00:56:39,910 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:56:39,910 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-22 00:56:39,910 INFO [RS:0;jenkins-hbase4:33391] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-22 00:56:39,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9941fea9cde602e11476e7ff7598d5f8, disabling compactions & flushes 2024-01-22 00:56:39,911 DEBUG [RS:0;jenkins-hbase4:33391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a458c2e to 127.0.0.1:62833 2024-01-22 00:56:39,910 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-22 00:56:39,911 DEBUG [RS:0;jenkins-hbase4:33391] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-22 00:56:39,910 INFO [RS:1;jenkins-hbase4:42117] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-22 00:56:39,911 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-01-22 00:56:39,911 INFO [RS:1;jenkins-hbase4:42117] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-22 00:56:39,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:56:39,911 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(3308): Received CLOSE for c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:56:39,911 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1481): Online Regions={9941fea9cde602e11476e7ff7598d5f8=hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8.} 2024-01-22 00:56:39,911 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:39,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:56:39,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c15f5a3c6a149eb81c4c59731e5b91f0, disabling compactions & flushes 2024-01-22 00:56:39,912 INFO [RS:1;jenkins-hbase4:42117] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-22 00:56:39,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:56:39,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. after waiting 0 ms 2024-01-22 00:56:39,912 DEBUG [RS:1;jenkins-hbase4:42117] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5161f982 to 127.0.0.1:62833 2024-01-22 00:56:39,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:56:39,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:56:39,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9941fea9cde602e11476e7ff7598d5f8 1/1 column families, dataSize=147 B heapSize=704 B 2024-01-22 00:56:39,912 DEBUG [RS:1;jenkins-hbase4:42117] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-22 00:56:39,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. after waiting 0 ms 2024-01-22 00:56:39,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:56:39,913 INFO [RS:1;jenkins-hbase4:42117] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-22 00:56:39,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c15f5a3c6a149eb81c4c59731e5b91f0 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-01-22 00:56:39,914 INFO [RS:1;jenkins-hbase4:42117] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-22 00:56:39,914 INFO [RS:1;jenkins-hbase4:42117] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-22 00:56:39,914 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2024-01-22 00:56:39,914 DEBUG [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1507): Waiting on 9941fea9cde602e11476e7ff7598d5f8 2024-01-22 00:56:39,914 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-01-22 00:56:39,914 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1481): Online Regions={c15f5a3c6a149eb81c4c59731e5b91f0=hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0., 1588230740=hbase:meta,,1.1588230740} 2024-01-22 00:56:39,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-22 00:56:39,915 DEBUG [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1507): Waiting on 1588230740, c15f5a3c6a149eb81c4c59731e5b91f0 2024-01-22 00:56:39,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-22 00:56:39,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-22 00:56:39,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-22 00:56:39,915 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-22 00:56:39,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-01-22 00:56:39,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8/.tmp/info/522ba001678f43fd85fa28c0262fec87 2024-01-22 00:56:39,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/.tmp/q/58d0f2b2e11a4d24abe935ba23d7da13 2024-01-22 00:56:39,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/.tmp/info/e173d50e9f634ffbacfc2123bf54eca2 2024-01-22 00:56:39,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58d0f2b2e11a4d24abe935ba23d7da13 2024-01-22 00:56:39,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e173d50e9f634ffbacfc2123bf54eca2 2024-01-22 00:56:39,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 522ba001678f43fd85fa28c0262fec87 2024-01-22 00:56:39,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8/.tmp/info/522ba001678f43fd85fa28c0262fec87 as hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8/info/522ba001678f43fd85fa28c0262fec87 2024-01-22 00:56:39,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 522ba001678f43fd85fa28c0262fec87 2024-01-22 00:56:39,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8/info/522ba001678f43fd85fa28c0262fec87, entries=3, sequenceid=8, filesize=5.0 K 2024-01-22 00:56:39,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 9941fea9cde602e11476e7ff7598d5f8 in 74ms, sequenceid=8, compaction requested=false 2024-01-22 00:56:39,995 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-22 00:56:39,995 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-22 00:56:39,997 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/.tmp/rep_barrier/513f14751cd14c578876333f02e7cbd1 2024-01-22 00:56:39,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/.tmp/u/370f4842c16e405b8e1ee084330c3f7d 2024-01-22 00:56:40,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 370f4842c16e405b8e1ee084330c3f7d 2024-01-22 00:56:40,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 513f14751cd14c578876333f02e7cbd1 2024-01-22 00:56:40,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/.tmp/q/58d0f2b2e11a4d24abe935ba23d7da13 as hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/q/58d0f2b2e11a4d24abe935ba23d7da13 2024-01-22 00:56:40,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/namespace/9941fea9cde602e11476e7ff7598d5f8/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-01-22 00:56:40,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:56:40,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9941fea9cde602e11476e7ff7598d5f8: 2024-01-22 00:56:40,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1705884932881.9941fea9cde602e11476e7ff7598d5f8. 2024-01-22 00:56:40,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58d0f2b2e11a4d24abe935ba23d7da13 2024-01-22 00:56:40,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/q/58d0f2b2e11a4d24abe935ba23d7da13, entries=5, sequenceid=17, filesize=5.1 K 2024-01-22 00:56:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/.tmp/u/370f4842c16e405b8e1ee084330c3f7d as hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/u/370f4842c16e405b8e1ee084330c3f7d 2024-01-22 00:56:40,027 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/.tmp/table/569b02b9fe124b179140c37ade5c9400 2024-01-22 00:56:40,035 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 569b02b9fe124b179140c37ade5c9400 2024-01-22 00:56:40,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 370f4842c16e405b8e1ee084330c3f7d 2024-01-22 00:56:40,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/u/370f4842c16e405b8e1ee084330c3f7d, entries=4, sequenceid=17, filesize=5.0 K 2024-01-22 00:56:40,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for c15f5a3c6a149eb81c4c59731e5b91f0 in 122ms, sequenceid=17, compaction requested=false 2024-01-22 00:56:40,037 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/.tmp/info/e173d50e9f634ffbacfc2123bf54eca2 as hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/info/e173d50e9f634ffbacfc2123bf54eca2 2024-01-22 00:56:40,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/quota/c15f5a3c6a149eb81c4c59731e5b91f0/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-01-22 00:56:40,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:56:40,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c15f5a3c6a149eb81c4c59731e5b91f0: 2024-01-22 00:56:40,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1705884933634.c15f5a3c6a149eb81c4c59731e5b91f0. 2024-01-22 00:56:40,048 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e173d50e9f634ffbacfc2123bf54eca2 2024-01-22 00:56:40,049 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/info/e173d50e9f634ffbacfc2123bf54eca2, entries=30, sequenceid=66, filesize=8.0 K 2024-01-22 00:56:40,050 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/.tmp/rep_barrier/513f14751cd14c578876333f02e7cbd1 as hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/rep_barrier/513f14751cd14c578876333f02e7cbd1 2024-01-22 00:56:40,058 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 513f14751cd14c578876333f02e7cbd1 2024-01-22 00:56:40,058 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/rep_barrier/513f14751cd14c578876333f02e7cbd1, entries=5, sequenceid=66, filesize=5.3 K 2024-01-22 00:56:40,059 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/.tmp/table/569b02b9fe124b179140c37ade5c9400 as hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/table/569b02b9fe124b179140c37ade5c9400 2024-01-22 00:56:40,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 569b02b9fe124b179140c37ade5c9400 2024-01-22 00:56:40,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/table/569b02b9fe124b179140c37ade5c9400, entries=13, sequenceid=66, filesize=5.6 K 2024-01-22 00:56:40,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 153ms, sequenceid=66, compaction requested=false 2024-01-22 00:56:40,077 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-01-22 00:56:40,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-22 00:56:40,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-22 00:56:40,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-22 00:56:40,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-01-22 00:56:40,114 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,33391,1705884930886; all regions closed. 2024-01-22 00:56:40,114 DEBUG [RS:0;jenkins-hbase4:33391] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-22 00:56:40,115 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,42117,1705884930934; all regions closed. 2024-01-22 00:56:40,115 DEBUG [RS:1;jenkins-hbase4:42117] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-22 00:56:40,126 DEBUG [RS:0;jenkins-hbase4:33391] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/oldWALs 2024-01-22 00:56:40,126 DEBUG [RS:1;jenkins-hbase4:42117] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/oldWALs 2024-01-22 00:56:40,126 INFO [RS:1;jenkins-hbase4:42117] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42117%2C1705884930934.meta:.meta(num 1705884932605) 2024-01-22 00:56:40,126 INFO [RS:0;jenkins-hbase4:33391] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33391%2C1705884930886:(num 1705884932415) 2024-01-22 00:56:40,126 DEBUG [RS:0;jenkins-hbase4:33391] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-22 00:56:40,126 INFO [RS:0;jenkins-hbase4:33391] regionserver.LeaseManager(133): Closed leases 2024-01-22 00:56:40,127 INFO [RS:0;jenkins-hbase4:33391] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-01-22 00:56:40,127 INFO [RS:0;jenkins-hbase4:33391] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-22 00:56:40,127 INFO [RS:0;jenkins-hbase4:33391] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-22 00:56:40,127 INFO [RS:0;jenkins-hbase4:33391] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-22 00:56:40,127 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-22 00:56:40,128 INFO [RS:0;jenkins-hbase4:33391] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33391 2024-01-22 00:56:40,134 DEBUG [RS:1;jenkins-hbase4:42117] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/oldWALs 2024-01-22 00:56:40,134 INFO [RS:1;jenkins-hbase4:42117] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42117%2C1705884930934:(num 1705884932415) 2024-01-22 00:56:40,134 DEBUG [RS:1;jenkins-hbase4:42117] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-22 00:56:40,134 INFO [RS:1;jenkins-hbase4:42117] regionserver.LeaseManager(133): Closed leases 2024-01-22 00:56:40,135 INFO [RS:1;jenkins-hbase4:42117] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-01-22 00:56:40,135 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-22 00:56:40,136 INFO [RS:1;jenkins-hbase4:42117] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42117 2024-01-22 00:56:40,138 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:56:40,138 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-22 00:56:40,138 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33391,1705884930886 2024-01-22 00:56:40,138 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-22 00:56:40,138 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-22 00:56:40,139 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:40,139 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42117,1705884930934 2024-01-22 00:56:40,139 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33391,1705884930886] 2024-01-22 00:56:40,139 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33391,1705884930886; numProcessing=1 2024-01-22 00:56:40,146 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33391,1705884930886 already deleted, retry=false 2024-01-22 00:56:40,147 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,33391,1705884930886 expired; onlineServers=1 2024-01-22 00:56:40,147 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42117,1705884930934] 2024-01-22 00:56:40,147 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42117,1705884930934; numProcessing=2 2024-01-22 00:56:40,148 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42117,1705884930934 already deleted, retry=false 2024-01-22 00:56:40,148 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,42117,1705884930934 expired; onlineServers=0 2024-01-22 00:56:40,148 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,33599,1705884929693' ***** 2024-01-22 00:56:40,148 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2024-01-22 00:56:40,148 DEBUG [M:0;jenkins-hbase4:33599] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c2ec03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-22 00:56:40,149 INFO [M:0;jenkins-hbase4:33599] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,33599,1705884929693 2024-01-22 00:56:40,149 INFO [M:0;jenkins-hbase4:33599] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,33599,1705884929693; all regions closed. 2024-01-22 00:56:40,149 DEBUG [M:0;jenkins-hbase4:33599] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-22 00:56:40,149 DEBUG [M:0;jenkins-hbase4:33599] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-01-22 00:56:40,149 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-01-22 00:56:40,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705884932087] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705884932087,5,FailOnTimeoutGroup] 2024-01-22 00:56:40,149 DEBUG [M:0;jenkins-hbase4:33599] cleaner.HFileCleaner(317): Stopping file delete threads 2024-01-22 00:56:40,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705884932086] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705884932086,5,FailOnTimeoutGroup] 2024-01-22 00:56:40,150 INFO [M:0;jenkins-hbase4:33599] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-01-22 00:56:40,150 INFO [M:0;jenkins-hbase4:33599] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-01-22 00:56:40,150 INFO [M:0;jenkins-hbase4:33599] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-01-22 00:56:40,150 DEBUG [M:0;jenkins-hbase4:33599] master.HMaster(1517): Stopping service threads 2024-01-22 00:56:40,150 INFO [M:0;jenkins-hbase4:33599] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-01-22 00:56:40,150 ERROR [M:0;jenkins-hbase4:33599] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-01-22 00:56:40,151 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-01-22 00:56:40,151 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-22 00:56:40,151 INFO [M:0;jenkins-hbase4:33599] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-01-22 00:56:40,151 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-01-22 00:56:40,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-22 00:56:40,152 DEBUG [M:0;jenkins-hbase4:33599] zookeeper.ZKUtil(399): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-01-22 00:56:40,152 WARN [M:0;jenkins-hbase4:33599] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-01-22 00:56:40,152 INFO [M:0;jenkins-hbase4:33599] assignment.AssignmentManager(315): Stopping assignment manager 2024-01-22 00:56:40,152 INFO [M:0;jenkins-hbase4:33599] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-01-22 00:56:40,152 DEBUG [M:0;jenkins-hbase4:33599] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-22 00:56:40,152 INFO [M:0;jenkins-hbase4:33599] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-22 00:56:40,152 DEBUG [M:0;jenkins-hbase4:33599] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-22 00:56:40,152 DEBUG [M:0;jenkins-hbase4:33599] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-22 00:56:40,152 DEBUG [M:0;jenkins-hbase4:33599] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-22 00:56:40,153 INFO [M:0;jenkins-hbase4:33599] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.97 KB heapSize=184.82 KB 2024-01-22 00:56:40,170 INFO [M:0;jenkins-hbase4:33599] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.97 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8cc3da9fdc5a4adfad6a02af3be3d8af 2024-01-22 00:56:40,176 INFO [M:0;jenkins-hbase4:33599] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cc3da9fdc5a4adfad6a02af3be3d8af 2024-01-22 00:56:40,177 DEBUG [M:0;jenkins-hbase4:33599] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8cc3da9fdc5a4adfad6a02af3be3d8af as hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8cc3da9fdc5a4adfad6a02af3be3d8af 2024-01-22 00:56:40,184 INFO [M:0;jenkins-hbase4:33599] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cc3da9fdc5a4adfad6a02af3be3d8af 2024-01-22 00:56:40,185 INFO [M:0;jenkins-hbase4:33599] regionserver.HStore(1080): Added hdfs://localhost:35681/user/jenkins/test-data/0bacd125-2bf4-9093-294a-3e51563011b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8cc3da9fdc5a4adfad6a02af3be3d8af, entries=45, sequenceid=376, filesize=12.0 K 2024-01-22 00:56:40,186 INFO [M:0;jenkins-hbase4:33599] regionserver.HRegion(2948): Finished flush of dataSize ~152.97 KB/156637, heapSize ~184.80 KB/189240, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=376, compaction requested=false 2024-01-22 00:56:40,187 INFO [M:0;jenkins-hbase4:33599] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-22 00:56:40,187 DEBUG [M:0;jenkins-hbase4:33599] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-22 00:56:40,191 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-22 00:56:40,191 INFO [M:0;jenkins-hbase4:33599] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-01-22 00:56:40,192 INFO [M:0;jenkins-hbase4:33599] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33599 2024-01-22 00:56:40,194 DEBUG [M:0;jenkins-hbase4:33599] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33599,1705884929693 already deleted, retry=false 2024-01-22 00:56:40,240 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-22 00:56:40,240 INFO [RS:0;jenkins-hbase4:33391] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,33391,1705884930886; zookeeper connection closed. 2024-01-22 00:56:40,240 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:33391-0x1014cba2f480001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-22 00:56:40,241 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4ac32511] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4ac32511 2024-01-22 00:56:40,241 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-22 00:56:40,241 INFO [RS:1;jenkins-hbase4:42117] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,42117,1705884930934; zookeeper connection closed. 2024-01-22 00:56:40,241 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): regionserver:42117-0x1014cba2f480002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-22 00:56:40,241 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@352a32ad] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@352a32ad 2024-01-22 00:56:40,241 INFO [Listener at localhost/37375] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-01-22 00:56:40,297 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-22 00:56:40,297 INFO [M:0;jenkins-hbase4:33599] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,33599,1705884929693; zookeeper connection closed. 2024-01-22 00:56:40,297 DEBUG [Listener at localhost/37375-EventThread] zookeeper.ZKWatcher(600): master:33599-0x1014cba2f480000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-22 00:56:40,298 WARN [Listener at localhost/37375] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-22 00:56:40,303 INFO [Listener at localhost/37375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-22 00:56:40,407 WARN [BP-1056000984-172.31.14.131-1705884925635 heartbeating to localhost/127.0.0.1:35681] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-22 00:56:40,408 WARN [BP-1056000984-172.31.14.131-1705884925635 heartbeating to localhost/127.0.0.1:35681] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1056000984-172.31.14.131-1705884925635 (Datanode Uuid 3412dabe-2f70-4bcb-be20-f625d3279f9b) service to localhost/127.0.0.1:35681 2024-01-22 00:56:40,410 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/cluster_6e6f0586-3649-b32f-f56a-fac4e4acd906/dfs/data/data3/current/BP-1056000984-172.31.14.131-1705884925635] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-22 00:56:40,410 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/cluster_6e6f0586-3649-b32f-f56a-fac4e4acd906/dfs/data/data4/current/BP-1056000984-172.31.14.131-1705884925635] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-22 00:56:40,413 WARN [Listener at localhost/37375] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-22 00:56:40,416 INFO [Listener at localhost/37375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-22 00:56:40,522 WARN [BP-1056000984-172.31.14.131-1705884925635 heartbeating to localhost/127.0.0.1:35681] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-22 00:56:40,522 WARN [BP-1056000984-172.31.14.131-1705884925635 heartbeating to localhost/127.0.0.1:35681] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1056000984-172.31.14.131-1705884925635 (Datanode Uuid c81bf780-b4c3-4e4a-ac52-7578cdd3b5f3) service to localhost/127.0.0.1:35681 2024-01-22 00:56:40,523 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/cluster_6e6f0586-3649-b32f-f56a-fac4e4acd906/dfs/data/data1/current/BP-1056000984-172.31.14.131-1705884925635] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-22 00:56:40,523 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/994bd48c-0806-0d7f-b774-6b4af360056a/cluster_6e6f0586-3649-b32f-f56a-fac4e4acd906/dfs/data/data2/current/BP-1056000984-172.31.14.131-1705884925635] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-22 00:56:40,559 INFO [Listener at localhost/37375] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-22 00:56:40,674 INFO [Listener at localhost/37375] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-01-22 00:56:40,711 INFO [Listener at localhost/37375] hbase.HBaseTestingUtility(1293): Minicluster is down