2023-12-21 17:55:23,474 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2023-12-21 17:55:23,731 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c 2023-12-21 17:55:23,744 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-12-21 17:55:23,744 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/cluster_156f09d0-dff3-4911-ef84-9605a394b831, deleteOnExit=true 2023-12-21 17:55:23,745 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-12-21 17:55:23,745 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/test.cache.data in system properties and HBase conf 2023-12-21 17:55:23,745 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/hadoop.tmp.dir in system properties and HBase conf 2023-12-21 17:55:23,746 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/hadoop.log.dir in system properties and HBase conf 2023-12-21 17:55:23,746 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-12-21 17:55:23,747 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-12-21 17:55:23,747 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-12-21 17:55:23,857 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-12-21 17:55:24,233 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-12-21 17:55:24,238 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-12-21 17:55:24,238 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-12-21 17:55:24,238 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-12-21 17:55:24,239 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-12-21 17:55:24,239 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-12-21 17:55:24,239 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-12-21 17:55:24,239 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-12-21 17:55:24,240 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-12-21 17:55:24,240 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-12-21 17:55:24,240 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/nfs.dump.dir in system properties and HBase conf 2023-12-21 17:55:24,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/java.io.tmpdir in system properties and HBase conf 2023-12-21 17:55:24,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-12-21 17:55:24,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-12-21 17:55:24,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-12-21 17:55:24,751 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-12-21 17:55:24,756 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-12-21 17:55:25,065 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-12-21 17:55:25,232 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-12-21 17:55:25,247 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-12-21 17:55:25,283 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-12-21 17:55:25,315 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/java.io.tmpdir/Jetty_localhost_35717_hdfs____.5abmu3/webapp 2023-12-21 17:55:25,439 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35717 2023-12-21 17:55:25,449 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-12-21 17:55:25,450 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-12-21 17:55:25,909 WARN [Listener at localhost/34195] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-12-21 17:55:25,974 WARN [Listener at localhost/34195] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-12-21 17:55:25,992 WARN [Listener at localhost/34195] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-12-21 17:55:25,999 INFO [Listener at localhost/34195] log.Slf4jLog(67): jetty-6.1.26 2023-12-21 17:55:26,004 INFO [Listener at localhost/34195] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/java.io.tmpdir/Jetty_localhost_36027_datanode____vgzk7t/webapp 2023-12-21 17:55:26,100 INFO [Listener at localhost/34195] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36027 2023-12-21 17:55:26,395 WARN [Listener at localhost/34391] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-12-21 17:55:26,406 WARN [Listener at localhost/34391] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-12-21 17:55:26,409 WARN [Listener at localhost/34391] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-12-21 17:55:26,411 INFO [Listener at localhost/34391] log.Slf4jLog(67): jetty-6.1.26 2023-12-21 17:55:26,419 INFO [Listener at localhost/34391] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/java.io.tmpdir/Jetty_localhost_46717_datanode____nn9v7m/webapp 2023-12-21 17:55:26,523 INFO [Listener at localhost/34391] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46717 2023-12-21 17:55:26,532 WARN [Listener at localhost/38251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-12-21 17:55:26,840 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x190ff69f0e559720: Processing first storage report for DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6 from datanode 1f06efff-de88-457c-9bf9-e44dac648d92 2023-12-21 17:55:26,842 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x190ff69f0e559720: from storage DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6 node DatanodeRegistration(127.0.0.1:42429, datanodeUuid=1f06efff-de88-457c-9bf9-e44dac648d92, infoPort=42525, infoSecurePort=0, ipcPort=34391, storageInfo=lv=-57;cid=testClusterID;nsid=650719888;c=1703181324833), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-12-21 17:55:26,842 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x43d7444272786011: Processing first storage report for DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5 from datanode 5e3865ed-661c-4a19-b580-508c65600503 2023-12-21 17:55:26,842 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x43d7444272786011: from storage DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5 node DatanodeRegistration(127.0.0.1:45693, datanodeUuid=5e3865ed-661c-4a19-b580-508c65600503, infoPort=42851, infoSecurePort=0, ipcPort=38251, storageInfo=lv=-57;cid=testClusterID;nsid=650719888;c=1703181324833), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-12-21 17:55:26,842 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x190ff69f0e559720: Processing first storage report for DS-1e0a10da-01d9-4b11-ab78-a5b2c3dcd39f from datanode 1f06efff-de88-457c-9bf9-e44dac648d92 2023-12-21 17:55:26,842 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x190ff69f0e559720: from storage DS-1e0a10da-01d9-4b11-ab78-a5b2c3dcd39f node DatanodeRegistration(127.0.0.1:42429, datanodeUuid=1f06efff-de88-457c-9bf9-e44dac648d92, infoPort=42525, infoSecurePort=0, ipcPort=34391, storageInfo=lv=-57;cid=testClusterID;nsid=650719888;c=1703181324833), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-12-21 17:55:26,843 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x43d7444272786011: Processing first storage report for DS-e54beff0-7d93-4604-a758-20657e1af505 from datanode 5e3865ed-661c-4a19-b580-508c65600503 2023-12-21 17:55:26,843 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x43d7444272786011: from storage DS-e54beff0-7d93-4604-a758-20657e1af505 node DatanodeRegistration(127.0.0.1:45693, datanodeUuid=5e3865ed-661c-4a19-b580-508c65600503, infoPort=42851, infoSecurePort=0, ipcPort=38251, storageInfo=lv=-57;cid=testClusterID;nsid=650719888;c=1703181324833), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-12-21 17:55:26,916 DEBUG [Listener at localhost/38251] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c 2023-12-21 17:55:27,042 INFO [Listener at localhost/38251] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/cluster_156f09d0-dff3-4911-ef84-9605a394b831/zookeeper_0, clientPort=57949, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/cluster_156f09d0-dff3-4911-ef84-9605a394b831/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/cluster_156f09d0-dff3-4911-ef84-9605a394b831/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-12-21 17:55:27,061 INFO [Listener at localhost/38251] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57949 2023-12-21 17:55:27,074 INFO [Listener at localhost/38251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:27,076 INFO [Listener at localhost/38251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:27,762 INFO [Listener at localhost/38251] util.FSUtils(471): Created version file at hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0 with version=8 2023-12-21 17:55:27,762 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/hbase-staging 2023-12-21 17:55:28,098 INFO [Listener at localhost/38251] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-12-21 17:55:28,547 INFO [Listener at localhost/38251] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2023-12-21 17:55:28,579 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:28,579 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:28,579 INFO [Listener at localhost/38251] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-12-21 17:55:28,579 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:28,580 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-12-21 17:55:28,724 INFO [Listener at localhost/38251] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-12-21 17:55:28,793 DEBUG [Listener at localhost/38251] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-12-21 17:55:28,892 INFO [Listener at localhost/38251] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34749 2023-12-21 17:55:28,902 INFO [Listener at localhost/38251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:28,906 INFO [Listener at localhost/38251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:28,929 INFO [Listener at localhost/38251] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34749 connecting to ZooKeeper ensemble=127.0.0.1:57949 2023-12-21 17:55:28,974 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:347490x0, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-12-21 17:55:28,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34749-0x100ab947eba0000 connected 2023-12-21 17:55:29,017 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-12-21 17:55:29,018 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-21 17:55:29,021 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-12-21 17:55:29,029 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34749 2023-12-21 17:55:29,029 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34749 2023-12-21 17:55:29,030 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34749 2023-12-21 17:55:29,030 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34749 2023-12-21 17:55:29,030 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34749 2023-12-21 17:55:29,036 INFO [Listener at localhost/38251] master.HMaster(445): hbase.rootdir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0, hbase.cluster.distributed=false 2023-12-21 17:55:29,104 INFO [Listener at localhost/38251] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-12-21 17:55:29,104 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:29,105 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:29,105 INFO [Listener at localhost/38251] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-12-21 17:55:29,105 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:29,105 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-12-21 17:55:29,110 INFO [Listener at localhost/38251] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-12-21 17:55:29,113 INFO [Listener at localhost/38251] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36257 2023-12-21 17:55:29,115 INFO [Listener at localhost/38251] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-12-21 17:55:29,122 DEBUG [Listener at localhost/38251] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-12-21 17:55:29,123 INFO [Listener at localhost/38251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:29,125 INFO [Listener at localhost/38251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:29,127 INFO [Listener at localhost/38251] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36257 connecting to ZooKeeper ensemble=127.0.0.1:57949 2023-12-21 17:55:29,131 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:362570x0, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-12-21 17:55:29,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36257-0x100ab947eba0001 connected 2023-12-21 17:55:29,133 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-12-21 17:55:29,134 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-21 17:55:29,136 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-12-21 17:55:29,136 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36257 2023-12-21 17:55:29,137 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36257 2023-12-21 17:55:29,143 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36257 2023-12-21 17:55:29,143 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36257 2023-12-21 17:55:29,143 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36257 2023-12-21 17:55:29,157 INFO [Listener at localhost/38251] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-12-21 17:55:29,157 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:29,157 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:29,158 INFO [Listener at localhost/38251] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-12-21 17:55:29,158 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-12-21 17:55:29,158 INFO [Listener at localhost/38251] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-12-21 17:55:29,158 INFO [Listener at localhost/38251] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-12-21 17:55:29,160 INFO [Listener at localhost/38251] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34957 2023-12-21 17:55:29,161 INFO [Listener at localhost/38251] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-12-21 17:55:29,162 DEBUG [Listener at localhost/38251] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-12-21 17:55:29,164 INFO [Listener at localhost/38251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:29,166 INFO [Listener at localhost/38251] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:29,168 INFO [Listener at localhost/38251] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34957 connecting to ZooKeeper ensemble=127.0.0.1:57949 2023-12-21 17:55:29,172 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:349570x0, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-12-21 17:55:29,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34957-0x100ab947eba0002 connected 2023-12-21 17:55:29,173 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-12-21 17:55:29,174 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-21 17:55:29,175 DEBUG [Listener at localhost/38251] zookeeper.ZKUtil(165): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-12-21 17:55:29,176 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34957 2023-12-21 17:55:29,177 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34957 2023-12-21 17:55:29,177 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34957 2023-12-21 17:55:29,183 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34957 2023-12-21 17:55:29,184 DEBUG [Listener at localhost/38251] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34957 2023-12-21 17:55:29,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:55:29,196 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-12-21 17:55:29,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:55:29,217 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-12-21 17:55:29,217 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-12-21 17:55:29,217 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-12-21 17:55:29,217 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:55:29,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-12-21 17:55:29,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34749,1703181327913 from backup master directory 2023-12-21 17:55:29,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-12-21 17:55:29,224 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:55:29,224 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-12-21 17:55:29,225 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-12-21 17:55:29,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:55:29,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-12-21 17:55:29,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-12-21 17:55:29,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/hbase.id with ID: 85aec1c9-0790-4145-929b-22a250d06865 2023-12-21 17:55:29,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-12-21 17:55:29,420 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:55:29,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4fa611e8 to 127.0.0.1:57949 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-21 17:55:29,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a7bcbb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-21 17:55:29,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-12-21 17:55:29,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-12-21 17:55:29,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-12-21 17:55:29,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-12-21 17:55:29,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2023-12-21 17:55:29,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2023-12-21 17:55:29,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-12-21 17:55:29,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store-tmp 2023-12-21 17:55:29,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:29,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-12-21 17:55:29,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-21 17:55:29,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-21 17:55:29,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-12-21 17:55:29,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-21 17:55:29,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-21 17:55:29,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-12-21 17:55:29,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/WALs/jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:55:29,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34749%2C1703181327913, suffix=, logDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/WALs/jenkins-hbase4.apache.org,34749,1703181327913, archiveDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/oldWALs, maxLogs=10 2023-12-21 17:55:29,748 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42429,DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6,DISK] 2023-12-21 17:55:29,748 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5,DISK] 2023-12-21 17:55:29,760 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-12-21 17:55:29,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/WALs/jenkins-hbase4.apache.org,34749,1703181327913/jenkins-hbase4.apache.org%2C34749%2C1703181327913.1703181329694 2023-12-21 17:55:29,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42429,DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6,DISK], DatanodeInfoWithStorage[127.0.0.1:45693,DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5,DISK]] 2023-12-21 17:55:29,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-12-21 17:55:29,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:29,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-12-21 17:55:29,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-12-21 17:55:29,895 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-12-21 17:55:29,902 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-12-21 17:55:29,925 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-12-21 17:55:29,936 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:29,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-12-21 17:55:29,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-12-21 17:55:29,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-12-21 17:55:29,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:29,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60708497, jitterRate=-0.09537290036678314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-21 17:55:29,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-12-21 17:55:29,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-12-21 17:55:29,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-12-21 17:55:29,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-12-21 17:55:29,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-12-21 17:55:29,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2023-12-21 17:55:30,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 32 msec 2023-12-21 17:55:30,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-12-21 17:55:30,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-12-21 17:55:30,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-12-21 17:55:30,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-12-21 17:55:30,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-12-21 17:55:30,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-12-21 17:55:30,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-12-21 17:55:30,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-12-21 17:55:30,088 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:55:30,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-12-21 17:55:30,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-12-21 17:55:30,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-12-21 17:55:30,111 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-12-21 17:55:30,111 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-12-21 17:55:30,111 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:55:30,111 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-12-21 17:55:30,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,34749,1703181327913, sessionid=0x100ab947eba0000, setting cluster-up flag (Was=false) 2023-12-21 17:55:30,128 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:55:30,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-12-21 17:55:30,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:55:30,140 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:55:30,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-12-21 17:55:30,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:55:30,151 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.hbase-snapshot/.tmp 2023-12-21 17:55:30,188 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(954): ClusterId : 85aec1c9-0790-4145-929b-22a250d06865 2023-12-21 17:55:30,188 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(954): ClusterId : 85aec1c9-0790-4145-929b-22a250d06865 2023-12-21 17:55:30,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2023-12-21 17:55:30,195 DEBUG [RS:0;jenkins-hbase4:36257] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-12-21 17:55:30,195 DEBUG [RS:1;jenkins-hbase4:34957] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-12-21 17:55:30,201 DEBUG [RS:0;jenkins-hbase4:36257] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-12-21 17:55:30,201 DEBUG [RS:1;jenkins-hbase4:34957] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-12-21 17:55:30,201 DEBUG [RS:0;jenkins-hbase4:36257] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-12-21 17:55:30,202 DEBUG [RS:1;jenkins-hbase4:34957] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-12-21 17:55:30,210 DEBUG [RS:1;jenkins-hbase4:34957] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-12-21 17:55:30,210 DEBUG [RS:0;jenkins-hbase4:36257] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-12-21 17:55:30,213 DEBUG [RS:1;jenkins-hbase4:34957] zookeeper.ReadOnlyZKClient(139): Connect 0x64288027 to 127.0.0.1:57949 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-21 17:55:30,213 DEBUG [RS:0;jenkins-hbase4:36257] zookeeper.ReadOnlyZKClient(139): Connect 0x7768e20d to 127.0.0.1:57949 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-21 17:55:30,219 DEBUG [RS:1;jenkins-hbase4:34957] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aef62d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-21 17:55:30,220 DEBUG [RS:0;jenkins-hbase4:36257] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79af1290, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-21 17:55:30,220 DEBUG [RS:1;jenkins-hbase4:34957] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ed0eb57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-12-21 17:55:30,220 DEBUG [RS:0;jenkins-hbase4:36257] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d90897d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-12-21 17:55:30,243 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34957 2023-12-21 17:55:30,246 INFO [RS:1;jenkins-hbase4:34957] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-12-21 17:55:30,246 INFO [RS:1;jenkins-hbase4:34957] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-12-21 17:55:30,246 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1025): About to register with Master. 2023-12-21 17:55:30,247 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36257 2023-12-21 17:55:30,247 INFO [RS:0;jenkins-hbase4:36257] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-12-21 17:55:30,248 INFO [RS:0;jenkins-hbase4:36257] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-12-21 17:55:30,248 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1025): About to register with Master. 2023-12-21 17:55:30,250 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,34749,1703181327913 with isa=jenkins-hbase4.apache.org/172.31.14.131:34957, startcode=1703181329156 2023-12-21 17:55:30,250 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,34749,1703181327913 with isa=jenkins-hbase4.apache.org/172.31.14.131:36257, startcode=1703181329103 2023-12-21 17:55:30,268 DEBUG [RS:0;jenkins-hbase4:36257] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-12-21 17:55:30,268 DEBUG [RS:1;jenkins-hbase4:34957] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-12-21 17:55:30,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-12-21 17:55:30,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-12-21 17:55:30,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-12-21 17:55:30,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-12-21 17:55:30,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-12-21 17:55:30,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-12-21 17:55:30,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-12-21 17:55:30,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1703181360288 2023-12-21 17:55:30,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-12-21 17:55:30,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-12-21 17:55:30,307 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-12-21 17:55:30,308 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-12-21 17:55:30,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-12-21 17:55:30,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-12-21 17:55:30,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-12-21 17:55:30,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-12-21 17:55:30,313 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-12-21 17:55:30,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-12-21 17:55:30,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-12-21 17:55:30,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-12-21 17:55:30,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-12-21 17:55:30,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-12-21 17:55:30,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1703181330324,5,FailOnTimeoutGroup] 2023-12-21 17:55:30,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1703181330324,5,FailOnTimeoutGroup] 2023-12-21 17:55:30,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-12-21 17:55:30,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,327 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55771, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-12-21 17:55:30,327 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38065, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-12-21 17:55:30,340 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34749] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:30,355 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-12-21 17:55:30,356 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-12-21 17:55:30,357 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34749] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:30,357 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0 2023-12-21 17:55:30,364 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0 2023-12-21 17:55:30,364 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0 2023-12-21 17:55:30,365 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:34195 2023-12-21 17:55:30,365 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:34195 2023-12-21 17:55:30,365 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2023-12-21 17:55:30,365 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2023-12-21 17:55:30,373 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-12-21 17:55:30,377 DEBUG [RS:0;jenkins-hbase4:36257] zookeeper.ZKUtil(163): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:30,377 WARN [RS:0;jenkins-hbase4:36257] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-12-21 17:55:30,378 DEBUG [RS:1;jenkins-hbase4:34957] zookeeper.ZKUtil(163): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:30,378 INFO [RS:0;jenkins-hbase4:36257] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-12-21 17:55:30,378 WARN [RS:1;jenkins-hbase4:34957] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-12-21 17:55:30,378 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1951): logDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/WALs/jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:30,379 INFO [RS:1;jenkins-hbase4:34957] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-12-21 17:55:30,379 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1951): logDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/WALs/jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:30,379 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34957,1703181329156] 2023-12-21 17:55:30,381 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36257,1703181329103] 2023-12-21 17:55:30,383 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:30,386 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-12-21 17:55:30,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/info 2023-12-21 17:55:30,389 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-12-21 17:55:30,391 DEBUG [RS:0;jenkins-hbase4:36257] zookeeper.ZKUtil(163): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:30,391 DEBUG [RS:1;jenkins-hbase4:34957] zookeeper.ZKUtil(163): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:30,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:30,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-12-21 17:55:30,392 DEBUG [RS:0;jenkins-hbase4:36257] zookeeper.ZKUtil(163): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:30,392 DEBUG [RS:1;jenkins-hbase4:34957] zookeeper.ZKUtil(163): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:30,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/rep_barrier 2023-12-21 17:55:30,395 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-12-21 17:55:30,396 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:30,396 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-12-21 17:55:30,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/table 2023-12-21 17:55:30,399 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-12-21 17:55:30,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:30,402 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740 2023-12-21 17:55:30,402 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740 2023-12-21 17:55:30,403 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-12-21 17:55:30,403 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-12-21 17:55:30,407 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-12-21 17:55:30,409 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-12-21 17:55:30,413 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:30,413 INFO [RS:0;jenkins-hbase4:36257] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-12-21 17:55:30,413 INFO [RS:1;jenkins-hbase4:34957] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-12-21 17:55:30,414 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73393573, jitterRate=0.09364946186542511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-12-21 17:55:30,414 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-12-21 17:55:30,414 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-12-21 17:55:30,414 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-12-21 17:55:30,414 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-12-21 17:55:30,414 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-12-21 17:55:30,414 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-12-21 17:55:30,415 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-12-21 17:55:30,416 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-12-21 17:55:30,420 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-12-21 17:55:30,420 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-12-21 17:55:30,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-12-21 17:55:30,432 INFO [RS:0;jenkins-hbase4:36257] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-12-21 17:55:30,432 INFO [RS:1;jenkins-hbase4:34957] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-12-21 17:55:30,435 INFO [RS:1;jenkins-hbase4:34957] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-21 17:55:30,435 INFO [RS:0;jenkins-hbase4:36257] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-12-21 17:55:30,436 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,436 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,437 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2023-12-21 17:55:30,437 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2023-12-21 17:55:30,443 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-12-21 17:55:30,446 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-12-21 17:55:30,446 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,446 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,446 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,446 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,447 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-12-21 17:55:30,447 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-12-21 17:55:30,447 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,448 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,448 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,448 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,448 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,448 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,448 DEBUG [RS:0;jenkins-hbase4:36257] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,448 DEBUG [RS:1;jenkins-hbase4:34957] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-12-21 17:55:30,449 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,449 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,449 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,450 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,450 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,450 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,450 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,450 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,465 INFO [RS:0;jenkins-hbase4:36257] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-12-21 17:55:30,465 INFO [RS:1;jenkins-hbase4:34957] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-12-21 17:55:30,468 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34957,1703181329156-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,468 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36257,1703181329103-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,487 INFO [RS:0;jenkins-hbase4:36257] regionserver.Replication(203): jenkins-hbase4.apache.org,36257,1703181329103 started 2023-12-21 17:55:30,487 INFO [RS:1;jenkins-hbase4:34957] regionserver.Replication(203): jenkins-hbase4.apache.org,34957,1703181329156 started 2023-12-21 17:55:30,487 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,36257,1703181329103, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36257, sessionid=0x100ab947eba0001 2023-12-21 17:55:30,487 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,34957,1703181329156, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34957, sessionid=0x100ab947eba0002 2023-12-21 17:55:30,487 DEBUG [RS:1;jenkins-hbase4:34957] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-12-21 17:55:30,487 DEBUG [RS:0;jenkins-hbase4:36257] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-12-21 17:55:30,487 DEBUG [RS:1;jenkins-hbase4:34957] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:30,487 DEBUG [RS:0;jenkins-hbase4:36257] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:30,488 DEBUG [RS:1;jenkins-hbase4:34957] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34957,1703181329156' 2023-12-21 17:55:30,488 DEBUG [RS:0;jenkins-hbase4:36257] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36257,1703181329103' 2023-12-21 17:55:30,489 DEBUG [RS:0;jenkins-hbase4:36257] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-21 17:55:30,489 DEBUG [RS:1;jenkins-hbase4:34957] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-12-21 17:55:30,490 DEBUG [RS:0;jenkins-hbase4:36257] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-21 17:55:30,490 DEBUG [RS:1;jenkins-hbase4:34957] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-12-21 17:55:30,490 DEBUG [RS:0;jenkins-hbase4:36257] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-12-21 17:55:30,490 DEBUG [RS:1;jenkins-hbase4:34957] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-12-21 17:55:30,490 DEBUG [RS:0;jenkins-hbase4:36257] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-12-21 17:55:30,490 DEBUG [RS:1;jenkins-hbase4:34957] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-12-21 17:55:30,490 DEBUG [RS:0;jenkins-hbase4:36257] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:30,490 DEBUG [RS:1;jenkins-hbase4:34957] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:30,491 DEBUG [RS:1;jenkins-hbase4:34957] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34957,1703181329156' 2023-12-21 17:55:30,491 DEBUG [RS:0;jenkins-hbase4:36257] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36257,1703181329103' 2023-12-21 17:55:30,491 DEBUG [RS:1;jenkins-hbase4:34957] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-12-21 17:55:30,491 DEBUG [RS:0;jenkins-hbase4:36257] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-12-21 17:55:30,492 DEBUG [RS:1;jenkins-hbase4:34957] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-12-21 17:55:30,492 DEBUG [RS:0;jenkins-hbase4:36257] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-12-21 17:55:30,492 DEBUG [RS:1;jenkins-hbase4:34957] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-12-21 17:55:30,492 DEBUG [RS:0;jenkins-hbase4:36257] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-12-21 17:55:30,492 INFO [RS:1;jenkins-hbase4:34957] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-12-21 17:55:30,492 INFO [RS:0;jenkins-hbase4:36257] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-12-21 17:55:30,495 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,495 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,495 DEBUG [RS:1;jenkins-hbase4:34957] zookeeper.ZKUtil(399): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-12-21 17:55:30,495 DEBUG [RS:0;jenkins-hbase4:36257] zookeeper.ZKUtil(399): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-12-21 17:55:30,496 INFO [RS:1;jenkins-hbase4:34957] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-12-21 17:55:30,496 INFO [RS:0;jenkins-hbase4:36257] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-12-21 17:55:30,496 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,496 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,496 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,496 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:30,597 DEBUG [jenkins-hbase4:34749] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-12-21 17:55:30,601 DEBUG [jenkins-hbase4:34749] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-12-21 17:55:30,607 DEBUG [jenkins-hbase4:34749] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-12-21 17:55:30,607 DEBUG [jenkins-hbase4:34749] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-12-21 17:55:30,608 DEBUG [jenkins-hbase4:34749] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-12-21 17:55:30,608 INFO [RS:1;jenkins-hbase4:34957] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34957%2C1703181329156, suffix=, logDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/WALs/jenkins-hbase4.apache.org,34957,1703181329156, archiveDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/oldWALs, maxLogs=32 2023-12-21 17:55:30,608 INFO [RS:0;jenkins-hbase4:36257] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36257%2C1703181329103, suffix=, logDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/WALs/jenkins-hbase4.apache.org,36257,1703181329103, archiveDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/oldWALs, maxLogs=32 2023-12-21 17:55:30,611 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36257,1703181329103, state=OPENING 2023-12-21 17:55:30,619 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-12-21 17:55:30,621 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:55:30,622 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-12-21 17:55:30,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36257,1703181329103}] 2023-12-21 17:55:30,633 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42429,DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6,DISK] 2023-12-21 17:55:30,633 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42429,DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6,DISK] 2023-12-21 17:55:30,634 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5,DISK] 2023-12-21 17:55:30,635 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5,DISK] 2023-12-21 17:55:30,666 INFO [RS:1;jenkins-hbase4:34957] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/WALs/jenkins-hbase4.apache.org,34957,1703181329156/jenkins-hbase4.apache.org%2C34957%2C1703181329156.1703181330613 2023-12-21 17:55:30,666 INFO [RS:0;jenkins-hbase4:36257] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/WALs/jenkins-hbase4.apache.org,36257,1703181329103/jenkins-hbase4.apache.org%2C36257%2C1703181329103.1703181330613 2023-12-21 17:55:30,667 DEBUG [RS:1;jenkins-hbase4:34957] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42429,DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6,DISK], DatanodeInfoWithStorage[127.0.0.1:45693,DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5,DISK]] 2023-12-21 17:55:30,667 DEBUG [RS:0;jenkins-hbase4:36257] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45693,DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5,DISK], DatanodeInfoWithStorage[127.0.0.1:42429,DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6,DISK]] 2023-12-21 17:55:30,831 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:30,834 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-12-21 17:55:30,837 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-12-21 17:55:30,848 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-12-21 17:55:30,849 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-12-21 17:55:30,852 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36257%2C1703181329103.meta, suffix=.meta, logDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/WALs/jenkins-hbase4.apache.org,36257,1703181329103, archiveDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/oldWALs, maxLogs=32 2023-12-21 17:55:30,869 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42429,DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6,DISK] 2023-12-21 17:55:30,869 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45693,DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5,DISK] 2023-12-21 17:55:30,874 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/WALs/jenkins-hbase4.apache.org,36257,1703181329103/jenkins-hbase4.apache.org%2C36257%2C1703181329103.meta.1703181330853.meta 2023-12-21 17:55:30,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42429,DS-7e444286-9f55-43ea-ba01-7dc929f2b5d6,DISK], DatanodeInfoWithStorage[127.0.0.1:45693,DS-5aaf2e52-db65-46d8-86b1-dc8cd90bfdc5,DISK]] 2023-12-21 17:55:30,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-12-21 17:55:30,877 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-12-21 17:55:30,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-12-21 17:55:30,898 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-12-21 17:55:30,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-12-21 17:55:30,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:30,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-12-21 17:55:30,904 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-12-21 17:55:30,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-12-21 17:55:30,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/info 2023-12-21 17:55:30,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/info 2023-12-21 17:55:30,909 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-12-21 17:55:30,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:30,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-12-21 17:55:30,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/rep_barrier 2023-12-21 17:55:30,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/rep_barrier 2023-12-21 17:55:30,913 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-12-21 17:55:30,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:30,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-12-21 17:55:30,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/table 2023-12-21 17:55:30,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/table 2023-12-21 17:55:30,916 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-12-21 17:55:30,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:30,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740 2023-12-21 17:55:30,921 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740 2023-12-21 17:55:30,924 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-12-21 17:55:30,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-12-21 17:55:30,928 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61447203, jitterRate=-0.08436532318592072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-12-21 17:55:30,928 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-12-21 17:55:30,940 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1703181330824 2023-12-21 17:55:30,960 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2023-12-21 17:55:30,961 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-12-21 17:55:30,962 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36257,1703181329103, state=OPEN 2023-12-21 17:55:30,966 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-12-21 17:55:30,966 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-12-21 17:55:30,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2023-12-21 17:55:30,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36257,1703181329103 in 341 msec 2023-12-21 17:55:30,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2023-12-21 17:55:30,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 542 msec 2023-12-21 17:55:30,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 778 msec 2023-12-21 17:55:30,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1703181330981, completionTime=-1 2023-12-21 17:55:30,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-12-21 17:55:30,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-12-21 17:55:31,045 DEBUG [hconnection-0x22e073fa-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-21 17:55:31,048 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-21 17:55:31,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2023-12-21 17:55:31,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1703181391063 2023-12-21 17:55:31,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1703181451064 2023-12-21 17:55:31,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 81 msec 2023-12-21 17:55:31,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34749,1703181327913-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:31,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34749,1703181327913-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:31,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34749,1703181327913-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:31,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34749, period=300000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:31,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:31,094 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-12-21 17:55:31,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-12-21 17:55:31,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-12-21 17:55:31,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-12-21 17:55:31,116 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-12-21 17:55:31,118 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-21 17:55:31,139 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/hbase/namespace/915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,142 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/hbase/namespace/915c845507b102bd66e09247defe05c0 empty. 2023-12-21 17:55:31,142 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/hbase/namespace/915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,142 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-12-21 17:55:31,169 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-12-21 17:55:31,171 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 915c845507b102bd66e09247defe05c0, NAME => 'hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp 2023-12-21 17:55:31,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:31,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 915c845507b102bd66e09247defe05c0, disabling compactions & flushes 2023-12-21 17:55:31,187 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:55:31,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:55:31,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. after waiting 0 ms 2023-12-21 17:55:31,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:55:31,187 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:55:31,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 915c845507b102bd66e09247defe05c0: 2023-12-21 17:55:31,191 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-12-21 17:55:31,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1703181331194"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181331194"}]},"ts":"1703181331194"} 2023-12-21 17:55:31,234 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-21 17:55:31,236 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-21 17:55:31,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181331236"}]},"ts":"1703181331236"} 2023-12-21 17:55:31,243 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-12-21 17:55:31,248 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-12-21 17:55:31,249 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-12-21 17:55:31,250 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-12-21 17:55:31,250 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-12-21 17:55:31,252 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=915c845507b102bd66e09247defe05c0, ASSIGN}] 2023-12-21 17:55:31,254 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=915c845507b102bd66e09247defe05c0, ASSIGN 2023-12-21 17:55:31,257 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=915c845507b102bd66e09247defe05c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34957,1703181329156; forceNewPlan=false, retain=false 2023-12-21 17:55:31,409 INFO [jenkins-hbase4:34749] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-12-21 17:55:31,410 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=915c845507b102bd66e09247defe05c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:31,410 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1703181331410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181331410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181331410"}]},"ts":"1703181331410"} 2023-12-21 17:55:31,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 915c845507b102bd66e09247defe05c0, server=jenkins-hbase4.apache.org,34957,1703181329156}] 2023-12-21 17:55:31,569 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:31,569 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-12-21 17:55:31,572 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-12-21 17:55:31,579 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:55:31,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 915c845507b102bd66e09247defe05c0, NAME => 'hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0.', STARTKEY => '', ENDKEY => ''} 2023-12-21 17:55:31,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:31,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,583 INFO [StoreOpener-915c845507b102bd66e09247defe05c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,585 DEBUG [StoreOpener-915c845507b102bd66e09247defe05c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0/info 2023-12-21 17:55:31,586 DEBUG [StoreOpener-915c845507b102bd66e09247defe05c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0/info 2023-12-21 17:55:31,586 INFO [StoreOpener-915c845507b102bd66e09247defe05c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 915c845507b102bd66e09247defe05c0 columnFamilyName info 2023-12-21 17:55:31,587 INFO [StoreOpener-915c845507b102bd66e09247defe05c0-1] regionserver.HStore(310): Store=915c845507b102bd66e09247defe05c0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:31,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,595 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 915c845507b102bd66e09247defe05c0 2023-12-21 17:55:31,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:31,600 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 915c845507b102bd66e09247defe05c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71949609, jitterRate=0.07213272154331207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-21 17:55:31,600 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 915c845507b102bd66e09247defe05c0: 2023-12-21 17:55:31,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0., pid=6, masterSystemTime=1703181331569 2023-12-21 17:55:31,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:55:31,608 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:55:31,610 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=915c845507b102bd66e09247defe05c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:31,610 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1703181331609"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1703181331609"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1703181331609"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1703181331609"}]},"ts":"1703181331609"} 2023-12-21 17:55:31,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2023-12-21 17:55:31,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 915c845507b102bd66e09247defe05c0, server=jenkins-hbase4.apache.org,34957,1703181329156 in 201 msec 2023-12-21 17:55:31,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2023-12-21 17:55:31,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=915c845507b102bd66e09247defe05c0, ASSIGN in 367 msec 2023-12-21 17:55:31,624 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-21 17:55:31,625 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181331625"}]},"ts":"1703181331625"} 2023-12-21 17:55:31,628 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-12-21 17:55:31,631 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-12-21 17:55:31,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 527 msec 2023-12-21 17:55:31,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-12-21 17:55:31,719 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-12-21 17:55:31,719 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:55:31,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-21 17:55:31,743 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-21 17:55:31,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-12-21 17:55:31,774 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-12-21 17:55:31,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-12-21 17:55:31,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-12-21 17:55:31,801 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-12-21 17:55:31,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-12-21 17:55:31,816 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-12-21 17:55:31,820 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-12-21 17:55:31,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.595sec 2023-12-21 17:55:31,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2023-12-21 17:55:31,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-12-21 17:55:31,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2023-12-21 17:55:31,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2023-12-21 17:55:31,826 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2023-12-21 17:55:31,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2023-12-21 17:55:31,828 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-21 17:55:31,831 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:31,832 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390 empty. 2023-12-21 17:55:31,834 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:31,834 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2023-12-21 17:55:31,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2023-12-21 17:55:31,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2023-12-21 17:55:31,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:31,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:31,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-12-21 17:55:31,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-12-21 17:55:31,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34749,1703181327913-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-12-21 17:55:31,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34749,1703181327913-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-12-21 17:55:31,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2023-12-21 17:55:31,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34749,1703181327913-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2023-12-21 17:55:31,855 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2023-12-21 17:55:31,856 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 026b594a2ee2a4d720e610685ddd9390, NAME => 'hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp 2023-12-21 17:55:31,875 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:31,875 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 026b594a2ee2a4d720e610685ddd9390, disabling compactions & flushes 2023-12-21 17:55:31,875 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:55:31,875 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:55:31,875 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. after waiting 0 ms 2023-12-21 17:55:31,875 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:55:31,875 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:55:31,875 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 026b594a2ee2a4d720e610685ddd9390: 2023-12-21 17:55:31,879 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2023-12-21 17:55:31,881 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1703181331880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181331880"}]},"ts":"1703181331880"} 2023-12-21 17:55:31,884 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-21 17:55:31,885 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-21 17:55:31,885 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181331885"}]},"ts":"1703181331885"} 2023-12-21 17:55:31,887 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2023-12-21 17:55:31,892 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-12-21 17:55:31,894 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-12-21 17:55:31,894 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-12-21 17:55:31,894 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-12-21 17:55:31,894 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=026b594a2ee2a4d720e610685ddd9390, ASSIGN}] 2023-12-21 17:55:31,896 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=026b594a2ee2a4d720e610685ddd9390, ASSIGN 2023-12-21 17:55:31,897 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=026b594a2ee2a4d720e610685ddd9390, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34957,1703181329156; forceNewPlan=false, retain=false 2023-12-21 17:55:31,898 DEBUG [Listener at localhost/38251] zookeeper.ReadOnlyZKClient(139): Connect 0x1b937afe to 127.0.0.1:57949 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-12-21 17:55:31,902 DEBUG [Listener at localhost/38251] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ba7e034, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-12-21 17:55:31,916 DEBUG [hconnection-0x4f09626-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-21 17:55:31,926 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-21 17:55:31,936 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:55:31,937 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:31,940 DEBUG [Listener at localhost/38251] client.ConnectionImplementation(716): Table hbase:quota not enabled 2023-12-21 17:55:32,042 DEBUG [Listener at localhost/38251] client.ConnectionImplementation(716): Table hbase:quota not enabled 2023-12-21 17:55:32,048 INFO [jenkins-hbase4:34749] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-12-21 17:55:32,049 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=026b594a2ee2a4d720e610685ddd9390, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:32,049 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1703181332048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181332048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181332048"}]},"ts":"1703181332048"} 2023-12-21 17:55:32,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 026b594a2ee2a4d720e610685ddd9390, server=jenkins-hbase4.apache.org,34957,1703181329156}] 2023-12-21 17:55:32,145 DEBUG [Listener at localhost/38251] client.ConnectionImplementation(716): Table hbase:quota not enabled 2023-12-21 17:55:32,205 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:32,210 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:55:32,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 026b594a2ee2a4d720e610685ddd9390, NAME => 'hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390.', STARTKEY => '', ENDKEY => ''} 2023-12-21 17:55:32,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:32,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:32,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:32,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:32,213 INFO [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:32,216 DEBUG [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/q 2023-12-21 17:55:32,216 DEBUG [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/q 2023-12-21 17:55:32,216 INFO [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 026b594a2ee2a4d720e610685ddd9390 columnFamilyName q 2023-12-21 17:55:32,217 INFO [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] regionserver.HStore(310): Store=026b594a2ee2a4d720e610685ddd9390/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:32,217 INFO [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:32,219 DEBUG [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/u 2023-12-21 17:55:32,219 DEBUG [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/u 2023-12-21 17:55:32,219 INFO [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 026b594a2ee2a4d720e610685ddd9390 columnFamilyName u 2023-12-21 17:55:32,220 INFO [StoreOpener-026b594a2ee2a4d720e610685ddd9390-1] regionserver.HStore(310): Store=026b594a2ee2a4d720e610685ddd9390/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:32,222 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:32,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:32,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-12-21 17:55:32,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:55:32,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:32,231 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 026b594a2ee2a4d720e610685ddd9390; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65740954, jitterRate=-0.020383447408676147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-12-21 17:55:32,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 026b594a2ee2a4d720e610685ddd9390: 2023-12-21 17:55:32,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390., pid=11, masterSystemTime=1703181332205 2023-12-21 17:55:32,235 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:55:32,235 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:55:32,236 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=026b594a2ee2a4d720e610685ddd9390, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:32,237 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1703181332236"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1703181332236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1703181332236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1703181332236"}]},"ts":"1703181332236"} 2023-12-21 17:55:32,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2023-12-21 17:55:32,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 026b594a2ee2a4d720e610685ddd9390, server=jenkins-hbase4.apache.org,34957,1703181329156 in 187 msec 2023-12-21 17:55:32,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2023-12-21 17:55:32,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=026b594a2ee2a4d720e610685ddd9390, ASSIGN in 348 msec 2023-12-21 17:55:32,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-21 17:55:32,247 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181332247"}]},"ts":"1703181332247"} 2023-12-21 17:55:32,247 DEBUG [Listener at localhost/38251] client.ConnectionImplementation(716): Table hbase:quota not enabled 2023-12-21 17:55:32,249 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2023-12-21 17:55:32,254 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2023-12-21 17:55:32,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 431 msec 2023-12-21 17:55:32,360 DEBUG [Listener at localhost/38251] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-21 17:55:32,363 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-12-21 17:55:32,379 DEBUG [hconnection-0x4f09626-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-21 17:55:32,382 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-12-21 17:55:32,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-12-21 17:55:32,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2023-12-21 17:55:32,398 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2023-12-21 17:55:32,400 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-21 17:55:32,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2023-12-21 17:55:32,402 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,403 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5 empty. 2023-12-21 17:55:32,404 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,404 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2023-12-21 17:55:32,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-12-21 17:55:32,421 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2023-12-21 17:55:32,422 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => c489be42ec5e4c0512d9b5bce1747bb5, NAME => 'TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp 2023-12-21 17:55:32,437 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:32,437 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing c489be42ec5e4c0512d9b5bce1747bb5, disabling compactions & flushes 2023-12-21 17:55:32,437 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:55:32,437 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:55:32,437 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. after waiting 0 ms 2023-12-21 17:55:32,437 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:55:32,437 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:55:32,437 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for c489be42ec5e4c0512d9b5bce1747bb5: 2023-12-21 17:55:32,441 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2023-12-21 17:55:32,443 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181332443"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181332443"}]},"ts":"1703181332443"} 2023-12-21 17:55:32,446 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-21 17:55:32,447 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-21 17:55:32,447 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181332447"}]},"ts":"1703181332447"} 2023-12-21 17:55:32,449 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2023-12-21 17:55:32,454 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-12-21 17:55:32,455 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-12-21 17:55:32,455 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-12-21 17:55:32,455 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-12-21 17:55:32,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c489be42ec5e4c0512d9b5bce1747bb5, ASSIGN}] 2023-12-21 17:55:32,457 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c489be42ec5e4c0512d9b5bce1747bb5, ASSIGN 2023-12-21 17:55:32,458 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c489be42ec5e4c0512d9b5bce1747bb5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34957,1703181329156; forceNewPlan=false, retain=false 2023-12-21 17:55:32,608 INFO [jenkins-hbase4:34749] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-12-21 17:55:32,609 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c489be42ec5e4c0512d9b5bce1747bb5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:32,610 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181332609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181332609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181332609"}]},"ts":"1703181332609"} 2023-12-21 17:55:32,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure c489be42ec5e4c0512d9b5bce1747bb5, server=jenkins-hbase4.apache.org,34957,1703181329156}] 2023-12-21 17:55:32,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-12-21 17:55:32,765 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:32,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:55:32,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c489be42ec5e4c0512d9b5bce1747bb5, NAME => 'TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.', STARTKEY => '', ENDKEY => ''} 2023-12-21 17:55:32,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:32,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,774 INFO [StoreOpener-c489be42ec5e4c0512d9b5bce1747bb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,776 DEBUG [StoreOpener-c489be42ec5e4c0512d9b5bce1747bb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/cf 2023-12-21 17:55:32,776 DEBUG [StoreOpener-c489be42ec5e4c0512d9b5bce1747bb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/cf 2023-12-21 17:55:32,777 INFO [StoreOpener-c489be42ec5e4c0512d9b5bce1747bb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c489be42ec5e4c0512d9b5bce1747bb5 columnFamilyName cf 2023-12-21 17:55:32,777 INFO [StoreOpener-c489be42ec5e4c0512d9b5bce1747bb5-1] regionserver.HStore(310): Store=c489be42ec5e4c0512d9b5bce1747bb5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:32,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:55:32,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:32,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c489be42ec5e4c0512d9b5bce1747bb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66813514, jitterRate=-0.004401057958602905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-21 17:55:32,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c489be42ec5e4c0512d9b5bce1747bb5: 2023-12-21 17:55:32,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5., pid=14, masterSystemTime=1703181332765 2023-12-21 17:55:32,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:55:32,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:55:32,793 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c489be42ec5e4c0512d9b5bce1747bb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:32,793 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181332793"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1703181332793"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1703181332793"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1703181332793"}]},"ts":"1703181332793"} 2023-12-21 17:55:32,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2023-12-21 17:55:32,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure c489be42ec5e4c0512d9b5bce1747bb5, server=jenkins-hbase4.apache.org,34957,1703181329156 in 184 msec 2023-12-21 17:55:32,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2023-12-21 17:55:32,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c489be42ec5e4c0512d9b5bce1747bb5, ASSIGN in 344 msec 2023-12-21 17:55:32,804 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-21 17:55:32,804 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181332804"}]},"ts":"1703181332804"} 2023-12-21 17:55:32,806 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2023-12-21 17:55:32,809 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2023-12-21 17:55:32,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 415 msec 2023-12-21 17:55:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-12-21 17:55:33,172 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2023-12-21 17:55:33,172 DEBUG [Listener at localhost/38251] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2023-12-21 17:55:33,173 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:33,177 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2023-12-21 17:55:33,178 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:33,178 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2023-12-21 17:55:33,178 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:33,191 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-21 17:55:33,194 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2023-12-21 17:55:33,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-12-21 17:55:33,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2023-12-21 17:55:33,198 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2023-12-21 17:55:33,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2023-12-21 17:55:33,200 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-21 17:55:33,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-12-21 17:55:33,203 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,204 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765 empty. 2023-12-21 17:55:33,205 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,205 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2023-12-21 17:55:33,225 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2023-12-21 17:55:33,226 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7fb03dd6cd42248fc7ec0a182142c765, NAME => 'TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp 2023-12-21 17:55:33,237 DEBUG [hconnection-0x739ae433-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-21 17:55:33,240 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-12-21 17:55:33,241 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:33,241 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 7fb03dd6cd42248fc7ec0a182142c765, disabling compactions & flushes 2023-12-21 17:55:33,242 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:55:33,242 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:55:33,242 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. after waiting 0 ms 2023-12-21 17:55:33,242 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:55:33,242 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:55:33,242 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 7fb03dd6cd42248fc7ec0a182142c765: 2023-12-21 17:55:33,247 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2023-12-21 17:55:33,250 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181333249"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181333249"}]},"ts":"1703181333249"} 2023-12-21 17:55:33,252 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-21 17:55:33,253 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-21 17:55:33,254 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181333253"}]},"ts":"1703181333253"} 2023-12-21 17:55:33,256 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2023-12-21 17:55:33,263 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-12-21 17:55:33,265 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-12-21 17:55:33,265 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-12-21 17:55:33,265 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-12-21 17:55:33,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7fb03dd6cd42248fc7ec0a182142c765, ASSIGN}] 2023-12-21 17:55:33,266 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7fb03dd6cd42248fc7ec0a182142c765, ASSIGN 2023-12-21 17:55:33,268 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7fb03dd6cd42248fc7ec0a182142c765, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36257,1703181329103; forceNewPlan=false, retain=false 2023-12-21 17:55:33,418 INFO [jenkins-hbase4:34749] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-12-21 17:55:33,419 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7fb03dd6cd42248fc7ec0a182142c765, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:33,419 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181333419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181333419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181333419"}]},"ts":"1703181333419"} 2023-12-21 17:55:33,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 7fb03dd6cd42248fc7ec0a182142c765, server=jenkins-hbase4.apache.org,36257,1703181329103}] 2023-12-21 17:55:33,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-12-21 17:55:33,575 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:33,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:55:33,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7fb03dd6cd42248fc7ec0a182142c765, NAME => 'TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.', STARTKEY => '', ENDKEY => ''} 2023-12-21 17:55:33,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:33,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,646 INFO [StoreOpener-7fb03dd6cd42248fc7ec0a182142c765-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,652 DEBUG [StoreOpener-7fb03dd6cd42248fc7ec0a182142c765-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765/cf 2023-12-21 17:55:33,652 DEBUG [StoreOpener-7fb03dd6cd42248fc7ec0a182142c765-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765/cf 2023-12-21 17:55:33,655 INFO [StoreOpener-7fb03dd6cd42248fc7ec0a182142c765-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fb03dd6cd42248fc7ec0a182142c765 columnFamilyName cf 2023-12-21 17:55:33,661 INFO [StoreOpener-7fb03dd6cd42248fc7ec0a182142c765-1] regionserver.HStore(310): Store=7fb03dd6cd42248fc7ec0a182142c765/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:33,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:55:33,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:33,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7fb03dd6cd42248fc7ec0a182142c765; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60902547, jitterRate=-0.092481330037117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-21 17:55:33,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7fb03dd6cd42248fc7ec0a182142c765: 2023-12-21 17:55:33,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765., pid=17, masterSystemTime=1703181333575 2023-12-21 17:55:33,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:55:33,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:55:33,751 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7fb03dd6cd42248fc7ec0a182142c765, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:33,752 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181333750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1703181333750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1703181333750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1703181333750"}]},"ts":"1703181333750"} 2023-12-21 17:55:33,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2023-12-21 17:55:33,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 7fb03dd6cd42248fc7ec0a182142c765, server=jenkins-hbase4.apache.org,36257,1703181329103 in 333 msec 2023-12-21 17:55:33,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2023-12-21 17:55:33,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7fb03dd6cd42248fc7ec0a182142c765, ASSIGN in 493 msec 2023-12-21 17:55:33,765 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-21 17:55:33,765 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181333765"}]},"ts":"1703181333765"} 2023-12-21 17:55:33,767 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2023-12-21 17:55:33,771 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2023-12-21 17:55:33,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 577 msec 2023-12-21 17:55:33,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2023-12-21 17:55:33,961 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2023-12-21 17:55:33,961 DEBUG [Listener at localhost/38251] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2023-12-21 17:55:33,961 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:33,966 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2023-12-21 17:55:33,966 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:33,966 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2023-12-21 17:55:33,967 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:33,986 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-12-21 17:55:33,993 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2023-12-21 17:55:33,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-12-21 17:55:33,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2023-12-21 17:55:34,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2023-12-21 17:55:34,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2023-12-21 17:55:34,022 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-21 17:55:34,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-12-21 17:55:34,026 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,027 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-12-21 17:55:34,027 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70 empty. 2023-12-21 17:55:34,028 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2023-12-21 17:55:34,028 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-12-21 17:55:34,065 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2023-12-21 17:55:34,068 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5cda864da99e60a937985483488e3d70, NAME => 'TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp 2023-12-21 17:55:34,121 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:34,121 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 5cda864da99e60a937985483488e3d70, disabling compactions & flushes 2023-12-21 17:55:34,121 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:55:34,121 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:55:34,121 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. after waiting 0 ms 2023-12-21 17:55:34,121 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:55:34,122 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:55:34,122 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 5cda864da99e60a937985483488e3d70: 2023-12-21 17:55:34,133 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2023-12-21 17:55:34,136 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181334135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181334135"}]},"ts":"1703181334135"} 2023-12-21 17:55:34,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-12-21 17:55:34,141 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-21 17:55:34,141 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181334141"}]},"ts":"1703181334141"} 2023-12-21 17:55:34,144 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2023-12-21 17:55:34,150 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-12-21 17:55:34,152 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-12-21 17:55:34,152 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-12-21 17:55:34,152 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-12-21 17:55:34,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=5cda864da99e60a937985483488e3d70, ASSIGN}] 2023-12-21 17:55:34,154 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=5cda864da99e60a937985483488e3d70, ASSIGN 2023-12-21 17:55:34,155 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=5cda864da99e60a937985483488e3d70, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36257,1703181329103; forceNewPlan=false, retain=false 2023-12-21 17:55:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-12-21 17:55:34,305 INFO [jenkins-hbase4:34749] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-12-21 17:55:34,306 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5cda864da99e60a937985483488e3d70, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:34,307 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181334306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181334306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181334306"}]},"ts":"1703181334306"} 2023-12-21 17:55:34,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 5cda864da99e60a937985483488e3d70, server=jenkins-hbase4.apache.org,36257,1703181329103}] 2023-12-21 17:55:34,508 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:34,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:55:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cda864da99e60a937985483488e3d70, NAME => 'TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.', STARTKEY => '', ENDKEY => ''} 2023-12-21 17:55:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,516 INFO [StoreOpener-5cda864da99e60a937985483488e3d70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,518 DEBUG [StoreOpener-5cda864da99e60a937985483488e3d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70/cf 2023-12-21 17:55:34,518 DEBUG [StoreOpener-5cda864da99e60a937985483488e3d70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70/cf 2023-12-21 17:55:34,519 INFO [StoreOpener-5cda864da99e60a937985483488e3d70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cda864da99e60a937985483488e3d70 columnFamilyName cf 2023-12-21 17:55:34,520 INFO [StoreOpener-5cda864da99e60a937985483488e3d70-1] regionserver.HStore(310): Store=5cda864da99e60a937985483488e3d70/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:34,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5cda864da99e60a937985483488e3d70 2023-12-21 17:55:34,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:34,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5cda864da99e60a937985483488e3d70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60865647, jitterRate=-0.09303118288516998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-21 17:55:34,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5cda864da99e60a937985483488e3d70: 2023-12-21 17:55:34,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70., pid=20, masterSystemTime=1703181334508 2023-12-21 17:55:34,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:55:34,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:55:34,536 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5cda864da99e60a937985483488e3d70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:34,536 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181334535"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1703181334535"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1703181334535"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1703181334535"}]},"ts":"1703181334535"} 2023-12-21 17:55:34,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2023-12-21 17:55:34,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 5cda864da99e60a937985483488e3d70, server=jenkins-hbase4.apache.org,36257,1703181329103 in 226 msec 2023-12-21 17:55:34,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2023-12-21 17:55:34,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=5cda864da99e60a937985483488e3d70, ASSIGN in 389 msec 2023-12-21 17:55:34,545 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-21 17:55:34,545 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181334545"}]},"ts":"1703181334545"} 2023-12-21 17:55:34,549 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2023-12-21 17:55:34,553 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2023-12-21 17:55:34,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 559 msec 2023-12-21 17:55:34,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2023-12-21 17:55:34,779 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2023-12-21 17:55:34,779 DEBUG [Listener at localhost/38251] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2023-12-21 17:55:34,779 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:34,782 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2023-12-21 17:55:34,783 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:34,783 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2023-12-21 17:55:34,783 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:34,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2023-12-21 17:55:34,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2023-12-21 17:55:34,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-12-21 17:55:34,815 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-12-21 17:55:34,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 23 msec 2023-12-21 17:55:35,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-12-21 17:55:35,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-12-21 17:55:35,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2023-12-21 17:55:35,066 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2023-12-21 17:55:35,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2023-12-21 17:55:35,067 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-12-21 17:55:35,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2023-12-21 17:55:35,071 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,071 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,071 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0 empty. 2023-12-21 17:55:35,072 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc empty. 2023-12-21 17:55:35,072 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,072 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,072 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2023-12-21 17:55:35,088 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2023-12-21 17:55:35,090 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => c53a85d93f67d403f656bb1f7e9c31c0, NAME => 'TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp 2023-12-21 17:55:35,090 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6c0133667c0062bff6162229a73525fc, NAME => 'TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp 2023-12-21 17:55:35,108 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:35,109 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing c53a85d93f67d403f656bb1f7e9c31c0, disabling compactions & flushes 2023-12-21 17:55:35,109 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:55:35,109 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:55:35,109 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. after waiting 0 ms 2023-12-21 17:55:35,109 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:55:35,109 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:55:35,110 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for c53a85d93f67d403f656bb1f7e9c31c0: 2023-12-21 17:55:35,110 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:35,111 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 6c0133667c0062bff6162229a73525fc, disabling compactions & flushes 2023-12-21 17:55:35,111 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:55:35,111 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:55:35,111 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. after waiting 0 ms 2023-12-21 17:55:35,111 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:55:35,111 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:55:35,111 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 6c0133667c0062bff6162229a73525fc: 2023-12-21 17:55:35,114 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2023-12-21 17:55:35,116 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181335116"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181335116"}]},"ts":"1703181335116"} 2023-12-21 17:55:35,116 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181335116"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181335116"}]},"ts":"1703181335116"} 2023-12-21 17:55:35,120 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-12-21 17:55:35,121 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-12-21 17:55:35,121 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181335121"}]},"ts":"1703181335121"} 2023-12-21 17:55:35,123 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2023-12-21 17:55:35,129 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-12-21 17:55:35,131 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-12-21 17:55:35,131 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-12-21 17:55:35,131 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-12-21 17:55:35,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=c53a85d93f67d403f656bb1f7e9c31c0, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=6c0133667c0062bff6162229a73525fc, ASSIGN}] 2023-12-21 17:55:35,133 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=6c0133667c0062bff6162229a73525fc, ASSIGN 2023-12-21 17:55:35,133 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=c53a85d93f67d403f656bb1f7e9c31c0, ASSIGN 2023-12-21 17:55:35,134 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=6c0133667c0062bff6162229a73525fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36257,1703181329103; forceNewPlan=false, retain=false 2023-12-21 17:55:35,134 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=c53a85d93f67d403f656bb1f7e9c31c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34957,1703181329156; forceNewPlan=false, retain=false 2023-12-21 17:55:35,284 INFO [jenkins-hbase4:34749] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-12-21 17:55:35,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c53a85d93f67d403f656bb1f7e9c31c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:35,286 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=6c0133667c0062bff6162229a73525fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:35,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181335286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181335286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181335286"}]},"ts":"1703181335286"} 2023-12-21 17:55:35,286 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181335286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181335286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181335286"}]},"ts":"1703181335286"} 2023-12-21 17:55:35,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure c53a85d93f67d403f656bb1f7e9c31c0, server=jenkins-hbase4.apache.org,34957,1703181329156}] 2023-12-21 17:55:35,290 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure 6c0133667c0062bff6162229a73525fc, server=jenkins-hbase4.apache.org,36257,1703181329103}] 2023-12-21 17:55:35,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2023-12-21 17:55:35,441 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:35,444 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:35,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:55:35,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c53a85d93f67d403f656bb1f7e9c31c0, NAME => 'TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.', STARTKEY => '', ENDKEY => '1'} 2023-12-21 17:55:35,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:35,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:55:35,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c0133667c0062bff6162229a73525fc, NAME => 'TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.', STARTKEY => '1', ENDKEY => ''} 2023-12-21 17:55:35,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-12-21 17:55:35,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,451 INFO [StoreOpener-c53a85d93f67d403f656bb1f7e9c31c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,452 INFO [StoreOpener-6c0133667c0062bff6162229a73525fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,453 DEBUG [StoreOpener-c53a85d93f67d403f656bb1f7e9c31c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0/cf 2023-12-21 17:55:35,453 DEBUG [StoreOpener-c53a85d93f67d403f656bb1f7e9c31c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0/cf 2023-12-21 17:55:35,454 INFO [StoreOpener-c53a85d93f67d403f656bb1f7e9c31c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c53a85d93f67d403f656bb1f7e9c31c0 columnFamilyName cf 2023-12-21 17:55:35,454 DEBUG [StoreOpener-6c0133667c0062bff6162229a73525fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc/cf 2023-12-21 17:55:35,454 DEBUG [StoreOpener-6c0133667c0062bff6162229a73525fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc/cf 2023-12-21 17:55:35,454 INFO [StoreOpener-6c0133667c0062bff6162229a73525fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c0133667c0062bff6162229a73525fc columnFamilyName cf 2023-12-21 17:55:35,454 INFO [StoreOpener-c53a85d93f67d403f656bb1f7e9c31c0-1] regionserver.HStore(310): Store=c53a85d93f67d403f656bb1f7e9c31c0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:35,456 INFO [StoreOpener-6c0133667c0062bff6162229a73525fc-1] regionserver.HStore(310): Store=6c0133667c0062bff6162229a73525fc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-12-21 17:55:35,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:55:35,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6c0133667c0062bff6162229a73525fc 2023-12-21 17:55:35,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:35,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-12-21 17:55:35,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c53a85d93f67d403f656bb1f7e9c31c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64762249, jitterRate=-0.03496728837490082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-21 17:55:35,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c53a85d93f67d403f656bb1f7e9c31c0: 2023-12-21 17:55:35,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6c0133667c0062bff6162229a73525fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71380833, jitterRate=0.06365729868412018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-12-21 17:55:35,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6c0133667c0062bff6162229a73525fc: 2023-12-21 17:55:35,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0., pid=25, masterSystemTime=1703181335441 2023-12-21 17:55:35,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc., pid=26, masterSystemTime=1703181335443 2023-12-21 17:55:35,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:55:35,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:55:35,470 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=6c0133667c0062bff6162229a73525fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:55:35,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:55:35,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:55:35,470 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181335470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1703181335470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1703181335470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1703181335470"}]},"ts":"1703181335470"} 2023-12-21 17:55:35,471 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c53a85d93f67d403f656bb1f7e9c31c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:55:35,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181335471"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1703181335471"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1703181335471"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1703181335471"}]},"ts":"1703181335471"} 2023-12-21 17:55:35,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2023-12-21 17:55:35,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure 6c0133667c0062bff6162229a73525fc, server=jenkins-hbase4.apache.org,36257,1703181329103 in 183 msec 2023-12-21 17:55:35,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2023-12-21 17:55:35,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure c53a85d93f67d403f656bb1f7e9c31c0, server=jenkins-hbase4.apache.org,34957,1703181329156 in 185 msec 2023-12-21 17:55:35,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=6c0133667c0062bff6162229a73525fc, ASSIGN in 345 msec 2023-12-21 17:55:35,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2023-12-21 17:55:35,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=c53a85d93f67d403f656bb1f7e9c31c0, ASSIGN in 347 msec 2023-12-21 17:55:35,482 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-12-21 17:55:35,482 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181335482"}]},"ts":"1703181335482"} 2023-12-21 17:55:35,483 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2023-12-21 17:55:35,487 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2023-12-21 17:55:35,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 425 msec 2023-12-21 17:55:35,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2023-12-21 17:55:35,821 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2023-12-21 17:55:35,822 DEBUG [Listener at localhost/38251] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2023-12-21 17:55:35,822 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:35,826 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2023-12-21 17:55:35,826 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:35,826 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2023-12-21 17:55:35,826 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:35,872 INFO [Listener at localhost/38251] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=310, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=167, AvailableMemoryMB=3560 2023-12-21 17:55:36,170 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:36,170 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:55:36,170 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703184935913 bypass), TestNs=QuotaState(ts=1703184935913 bypass)} 2023-12-21 17:55:36,170 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703184935913 bypass), TestQuotaAdmin2=QuotaState(ts=1703184935913 bypass), TestQuotaAdmin1=QuotaState(ts=1703184935913 bypass)} 2023-12-21 17:55:36,170 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703184935913 [ TestNs:TestTable ])} 2023-12-21 17:55:36,170 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703184935913 bypass)} 2023-12-21 17:55:36,420 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:36,421 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:55:36,421 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703184935913 bypass), TestNs=QuotaState(ts=1703184935913 bypass)} 2023-12-21 17:55:36,421 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703184935913 bypass), TestNs:TestTable=QuotaState(ts=1703184935913 bypass)} 2023-12-21 17:55:36,421 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703184935913 [ TestNs:TestTable ])} 2023-12-21 17:55:36,421 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703184935913 bypass)} 2023-12-21 17:55:36,428 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-12-21 17:55:36,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:36,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181346437, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:36,529 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2023-12-21 17:55:36,531 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-12-21 17:55:36,531 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2023-12-21 17:55:36,532 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2023-12-21 17:55:36,533 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-12-21 17:55:36,534 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2023-12-21 17:55:36,534 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2023-12-21 17:55:36,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:36,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181346438, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:37,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:37,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181346438, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:38,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:38,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181346438, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:38,093 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-12-21 17:55:38,093 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2023-12-21 17:55:38,094 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-12-21 17:55:38,094 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-12-21 17:55:39,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:39,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181346438, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:41,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:41,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181346437, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:41,784 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10367: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc., hostname=jenkins-hbase4.apache.org,36257,1703181329103, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:55:41,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:41,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:54242 deadline: 1703181351787, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:42,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:42,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:54242 deadline: 1703181351786, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:42,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:42,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:54242 deadline: 1703181351787, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:43,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:43,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:54242 deadline: 1703181351787, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:44,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:44,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:54242 deadline: 1703181351787, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:47,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:47,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:54242 deadline: 1703181351786, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:55:47,071 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10323: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc., hostname=jenkins-hbase4.apache.org,36257,1703181329103, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:55:47,331 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:47,332 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:55:47,332 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703188535913 bypass), TestNs=QuotaState(ts=1703188535913 bypass)} 2023-12-21 17:55:47,332 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703188535913 bypass), TestQuotaAdmin2=QuotaState(ts=1703188535913 bypass), TestQuotaAdmin1=QuotaState(ts=1703188535913 bypass)} 2023-12-21 17:55:47,332 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703188535913 bypass)} 2023-12-21 17:55:47,332 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703188535913 bypass)} 2023-12-21 17:55:47,582 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:47,582 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:55:47,583 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703188535913 bypass), TestNs=QuotaState(ts=1703188535913 bypass)} 2023-12-21 17:55:47,583 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703188535913 bypass), TestNs:TestTable=QuotaState(ts=1703188535913 bypass)} 2023-12-21 17:55:47,583 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703188535913 bypass)} 2023-12-21 17:55:47,583 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703188535913 bypass)} 2023-12-21 17:55:47,596 INFO [Listener at localhost/38251] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=292 (was 310), OpenFileDescriptor=603 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 254), ProcessCount=165 (was 167), AvailableMemoryMB=5326 (was 3560) - AvailableMemoryMB LEAK? - 2023-12-21 17:55:47,607 INFO [Listener at localhost/38251] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=165, AvailableMemoryMB=5326 2023-12-21 17:55:47,870 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:47,870 INFO [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2023-12-21 17:55:48,120 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:55:48,121 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703192136013 bypass), TestNs=QuotaState(ts=1703192136013 bypass)} 2023-12-21 17:55:48,122 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703192136013 bypass), TestQuotaAdmin2=QuotaState(ts=1703192136013 bypass), TestQuotaAdmin1=QuotaState(ts=1703192136013 bypass)} 2023-12-21 17:55:48,122 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703192136013 [ default ])} 2023-12-21 17:55:48,122 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703192136013 bypass)} 2023-12-21 17:55:48,373 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:48,373 INFO [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2023-12-21 17:55:48,623 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:55:48,624 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703192136113 bypass), TestNs=QuotaState(ts=1703192136113 bypass)} 2023-12-21 17:55:48,625 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703192136113 bypass), TestNs:TestTable=QuotaState(ts=1703192136113 bypass)} 2023-12-21 17:55:48,625 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703192136113 [ default ])} 2023-12-21 17:55:48,626 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703192136113 bypass)} 2023-12-21 17:55:48,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:48,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:52912 deadline: 1703181358635, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:48,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:48,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:52912 deadline: 1703181358635, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:49,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:49,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:52912 deadline: 1703181358635, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:50,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:50,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181358635, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:51,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:51,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181358635, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:53,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:53,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181358635, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2023-12-21 17:55:53,919 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10322: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5., hostname=jenkins-hbase4.apache.org,34957,1703181329156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:55:53,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:53,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181363933, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:54,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:54,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181363934, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:54,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:54,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181363934, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:55,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:55,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181363934, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:56,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:56,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181363934, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:59,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:59,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181363933, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:55:59,245 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10352: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5., hostname=jenkins-hbase4.apache.org,34957,1703181329156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:55:59,501 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:59,501 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:55:59,501 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703195736113 bypass), TestNs=QuotaState(ts=1703195736113 bypass)} 2023-12-21 17:55:59,501 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703195736113 bypass), TestQuotaAdmin2=QuotaState(ts=1703195736113 bypass), TestQuotaAdmin1=QuotaState(ts=1703195736113 bypass)} 2023-12-21 17:55:59,501 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703195736113 bypass)} 2023-12-21 17:55:59,501 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703195736113 bypass)} 2023-12-21 17:55:59,752 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:55:59,752 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:55:59,752 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703195736113 bypass), TestNs=QuotaState(ts=1703195736113 bypass)} 2023-12-21 17:55:59,752 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703195736113 bypass), TestNs:TestTable=QuotaState(ts=1703195736113 bypass)} 2023-12-21 17:55:59,752 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703195736113 bypass)} 2023-12-21 17:55:59,752 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703195736113 bypass)} 2023-12-21 17:55:59,764 INFO [Listener at localhost/38251] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292 (was 292), OpenFileDescriptor=599 (was 603), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=180 (was 223), ProcessCount=165 (was 165), AvailableMemoryMB=5325 (was 5326) 2023-12-21 17:55:59,776 INFO [Listener at localhost/38251] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=292, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=180, ProcessCount=165, AvailableMemoryMB=5325 2023-12-21 17:56:00,037 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:00,037 INFO [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2023-12-21 17:56:00,288 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:00,289 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703199336213 bypass), TestNs=QuotaState(ts=1703199336213 bypass)} 2023-12-21 17:56:00,290 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703199336213 bypass), TestQuotaAdmin2=QuotaState(ts=1703199336213 bypass), TestQuotaAdmin1=QuotaState(ts=1703199336213 bypass)} 2023-12-21 17:56:00,290 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703199336213 global-limiter)} 2023-12-21 17:56:00,290 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703199336213 bypass)} 2023-12-21 17:56:00,541 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:00,541 INFO [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2023-12-21 17:56:00,791 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:00,792 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703199336313 bypass), TestNs=QuotaState(ts=1703199336313 bypass)} 2023-12-21 17:56:00,793 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703199336313 bypass), TestNs:TestTable=QuotaState(ts=1703199336313 bypass)} 2023-12-21 17:56:00,793 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703199336313 global-limiter)} 2023-12-21 17:56:00,793 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703199336313 bypass)} 2023-12-21 17:56:00,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:00,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181370806, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:01,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:01,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181370806, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:01,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:01,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181370807, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:02,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:02,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181370807, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:03,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:03,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181370807, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:06,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:06,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181370806, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:06,108 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10344: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5., hostname=jenkins-hbase4.apache.org,34957,1703181329156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:56:06,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:06,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181376114, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:06,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:06,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181376114, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:06,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:06,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181376114, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:07,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:07,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181376114, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:08,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:08,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181376115, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:11,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:11,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181376115, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2023-12-21 17:56:11,417 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10326: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5., hostname=jenkins-hbase4.apache.org,34957,1703181329156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:56:11,674 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:11,674 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:11,674 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703202936313 bypass), TestNs=QuotaState(ts=1703202936313 bypass)} 2023-12-21 17:56:11,674 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703202936313 bypass), TestQuotaAdmin2=QuotaState(ts=1703202936313 bypass), TestQuotaAdmin1=QuotaState(ts=1703202936313 bypass)} 2023-12-21 17:56:11,674 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703202936313 bypass)} 2023-12-21 17:56:11,674 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703202936313 bypass)} 2023-12-21 17:56:11,924 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:11,925 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:11,925 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703202936313 bypass), TestNs=QuotaState(ts=1703202936313 bypass)} 2023-12-21 17:56:11,925 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703202936313 bypass), TestNs:TestTable=QuotaState(ts=1703202936313 bypass)} 2023-12-21 17:56:11,925 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703202936313 bypass)} 2023-12-21 17:56:11,925 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703202936313 bypass)} 2023-12-21 17:56:11,936 INFO [Listener at localhost/38251] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=283 (was 292), OpenFileDescriptor=597 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=153 (was 180), ProcessCount=165 (was 165), AvailableMemoryMB=5327 (was 5325) - AvailableMemoryMB LEAK? - 2023-12-21 17:56:11,948 INFO [Listener at localhost/38251] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=283, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=165, AvailableMemoryMB=5326 2023-12-21 17:56:12,204 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:12,205 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:12,206 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703206536313 bypass), TestNs=QuotaState(ts=1703206536313 bypass)} 2023-12-21 17:56:12,207 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703206536313 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1703206536313 bypass), TestQuotaAdmin1=QuotaState(ts=1703206536313 bypass)} 2023-12-21 17:56:12,208 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {} 2023-12-21 17:56:12,209 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703206536313 bypass)} 2023-12-21 17:56:12,459 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:12,459 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:12,459 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703206536313 bypass), TestNs=QuotaState(ts=1703206536313 bypass)} 2023-12-21 17:56:12,460 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703206536313 bypass), TestNs:TestTable=QuotaState(ts=1703206536313 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000)))} 2023-12-21 17:56:12,460 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {} 2023-12-21 17:56:12,460 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703206536313 bypass)} 2023-12-21 17:56:12,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:12,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:54242 deadline: 1703181382477, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:12,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:12,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:54242 deadline: 1703181382476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:13,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:13,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:54242 deadline: 1703181382477, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:13,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:13,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:54242 deadline: 1703181382477, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:15,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:15,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:54242 deadline: 1703181382476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:17,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:17,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:54242 deadline: 1703181382476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:17,772 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10327: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc., hostname=jenkins-hbase4.apache.org,36257,1703181329103, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:56:17,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:17,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181387774, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:18,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:18,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181387773, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:18,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:18,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181387774, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:19,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:19,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181387773, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:20,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:20,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181387774, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:23,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:23,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36257] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:54242 deadline: 1703181387774, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2023-12-21 17:56:23,079 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10349: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc., hostname=jenkins-hbase4.apache.org,36257,1703181329103, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:56:23,335 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:23,336 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:23,336 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703210136313 bypass), TestNs=QuotaState(ts=1703210136313 bypass)} 2023-12-21 17:56:23,336 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703210136313 bypass), TestQuotaAdmin2=QuotaState(ts=1703210136313 bypass), TestQuotaAdmin1=QuotaState(ts=1703210136313 bypass)} 2023-12-21 17:56:23,336 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703210136313 bypass)} 2023-12-21 17:56:23,336 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703210136313 bypass)} 2023-12-21 17:56:23,586 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:23,586 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:23,586 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703210136313 bypass), TestNs=QuotaState(ts=1703210136313 bypass)} 2023-12-21 17:56:23,586 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703210136313 bypass), TestNs:TestTable=QuotaState(ts=1703210136313 bypass)} 2023-12-21 17:56:23,586 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {} 2023-12-21 17:56:23,586 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703210136313 bypass)} 2023-12-21 17:56:23,598 INFO [Listener at localhost/38251] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282 (was 283), OpenFileDescriptor=597 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=119 (was 153), ProcessCount=165 (was 165), AvailableMemoryMB=5324 (was 5326) 2023-12-21 17:56:23,609 INFO [Listener at localhost/38251] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=282, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=119, ProcessCount=165, AvailableMemoryMB=5324 2023-12-21 17:56:23,871 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:23,871 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:23,872 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703213736313 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1703213736313 bypass)} 2023-12-21 17:56:23,872 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703213736313 bypass), TestQuotaAdmin2=QuotaState(ts=1703213736313 bypass), TestQuotaAdmin1=QuotaState(ts=1703213736313 bypass)} 2023-12-21 17:56:23,872 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {} 2023-12-21 17:56:23,872 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703213736313 bypass)} 2023-12-21 17:56:24,122 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:24,123 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:24,124 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703213736313 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1703213736313 bypass)} 2023-12-21 17:56:24,124 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703213736313 bypass), TestNs:TestTable=QuotaState(ts=1703213736313 bypass)} 2023-12-21 17:56:24,124 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {} 2023-12-21 17:56:24,124 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703213736313 bypass)} 2023-12-21 17:56:24,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:24,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181394137, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:24,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:24,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181394136, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:24,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:24,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181394137, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:25,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:25,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181394137, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:26,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:26,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181394136, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:29,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:29,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52912 deadline: 1703181394137, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2023-12-21 17:56:29,442 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10316: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5., hostname=jenkins-hbase4.apache.org,34957,1703181329156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:56:29,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:29,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181399450, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:29,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:29,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181399451, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:30,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:30,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181399451, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:30,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:30,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181399451, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:32,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:32,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181399451, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:34,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:34,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34957] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52912 deadline: 1703181399451, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2023-12-21 17:56:34,754 ERROR [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10312: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5., hostname=jenkins-hbase4.apache.org,34957,1703181329156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-12-21 17:56:35,011 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:35,011 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:35,011 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703217336313 bypass), TestNs=QuotaState(ts=1703217336313 bypass)} 2023-12-21 17:56:35,011 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1703217336313 bypass), TestQuotaAdmin2=QuotaState(ts=1703217336313 bypass), TestQuotaAdmin1=QuotaState(ts=1703217336313 bypass)} 2023-12-21 17:56:35,011 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {} 2023-12-21 17:56:35,011 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703217336313 bypass)} 2023-12-21 17:56:35,261 INFO [Listener at localhost/38251] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-12-21 17:56:35,262 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2023-12-21 17:56:35,262 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1703217336313 bypass), TestNs=QuotaState(ts=1703217336313 bypass)} 2023-12-21 17:56:35,262 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1703217336313 bypass), TestNs:TestTable=QuotaState(ts=1703217336313 bypass)} 2023-12-21 17:56:35,262 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1703217336313 bypass)} 2023-12-21 17:56:35,262 DEBUG [Listener at localhost/38251] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1703217336313 bypass)} 2023-12-21 17:56:35,273 INFO [Listener at localhost/38251] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 282), OpenFileDescriptor=588 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=100 (was 119), ProcessCount=165 (was 165), AvailableMemoryMB=5326 (was 5324) - AvailableMemoryMB LEAK? - 2023-12-21 17:56:35,276 INFO [Listener at localhost/38251] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2023-12-21 17:56:35,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2023-12-21 17:56:35,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2023-12-21 17:56:35,291 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181395290"}]},"ts":"1703181395290"} 2023-12-21 17:56:35,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-21 17:56:35,292 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2023-12-21 17:56:35,295 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2023-12-21 17:56:35,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c489be42ec5e4c0512d9b5bce1747bb5, UNASSIGN}] 2023-12-21 17:56:35,298 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c489be42ec5e4c0512d9b5bce1747bb5, UNASSIGN 2023-12-21 17:56:35,299 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c489be42ec5e4c0512d9b5bce1747bb5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:56:35,299 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181395298"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181395298"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181395298"}]},"ts":"1703181395298"} 2023-12-21 17:56:35,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure c489be42ec5e4c0512d9b5bce1747bb5, server=jenkins-hbase4.apache.org,34957,1703181329156}] 2023-12-21 17:56:35,444 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,34957,1703181329156, timeout=1703181395455, delay=11, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure c489be42ec5e4c0512d9b5bce1747bb5, server=jenkins-hbase4.apache.org,34957,1703181329156]] 2023-12-21 17:56:35,457 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:56:35,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:56:35,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c489be42ec5e4c0512d9b5bce1747bb5, disabling compactions & flushes 2023-12-21 17:56:35,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:56:35,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:56:35,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. after waiting 0 ms 2023-12-21 17:56:35,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:56:35,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c489be42ec5e4c0512d9b5bce1747bb5 1/1 column families, dataSize=578 B heapSize=2.11 KB 2023-12-21 17:56:35,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/.tmp/cf/988e12eb4fbf474a876cedd3ce3369a7 2023-12-21 17:56:35,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-21 17:56:35,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/.tmp/cf/988e12eb4fbf474a876cedd3ce3369a7 as hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/cf/988e12eb4fbf474a876cedd3ce3369a7 2023-12-21 17:56:35,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/cf/988e12eb4fbf474a876cedd3ce3369a7, entries=6, sequenceid=21, filesize=4.7 K 2023-12-21 17:56:35,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for c489be42ec5e4c0512d9b5bce1747bb5 in 128ms, sequenceid=21, compaction requested=false 2023-12-21 17:56:35,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-12-21 17:56:35,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5. 2023-12-21 17:56:35,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c489be42ec5e4c0512d9b5bce1747bb5: 2023-12-21 17:56:35,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:56:35,600 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c489be42ec5e4c0512d9b5bce1747bb5, regionState=CLOSED 2023-12-21 17:56:35,600 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181395600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181395600"}]},"ts":"1703181395600"} 2023-12-21 17:56:35,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2023-12-21 17:56:35,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure c489be42ec5e4c0512d9b5bce1747bb5, server=jenkins-hbase4.apache.org,34957,1703181329156 in 302 msec 2023-12-21 17:56:35,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2023-12-21 17:56:35,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c489be42ec5e4c0512d9b5bce1747bb5, UNASSIGN in 307 msec 2023-12-21 17:56:35,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181395607"}]},"ts":"1703181395607"} 2023-12-21 17:56:35,608 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2023-12-21 17:56:35,610 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2023-12-21 17:56:35,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 329 msec 2023-12-21 17:56:36,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-12-21 17:56:36,044 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2023-12-21 17:56:36,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2023-12-21 17:56:36,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2023-12-21 17:56:36,057 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2023-12-21 17:56:36,059 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2023-12-21 17:56:36,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2023-12-21 17:56:36,065 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:56:36,068 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/cf, FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/recovered.edits] 2023-12-21 17:56:36,077 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/cf/988e12eb4fbf474a876cedd3ce3369a7 to hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/archive/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/cf/988e12eb4fbf474a876cedd3ce3369a7 2023-12-21 17:56:36,081 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/recovered.edits/24.seqid to hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/archive/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5/recovered.edits/24.seqid 2023-12-21 17:56:36,082 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin0/c489be42ec5e4c0512d9b5bce1747bb5 2023-12-21 17:56:36,082 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2023-12-21 17:56:36,086 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2023-12-21 17:56:36,105 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2023-12-21 17:56:36,108 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2023-12-21 17:56:36,109 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2023-12-21 17:56:36,109 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2023-12-21 17:56:36,110 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1703181396109"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:36,111 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-12-21 17:56:36,112 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c489be42ec5e4c0512d9b5bce1747bb5, NAME => 'TestQuotaAdmin0,,1703181332390.c489be42ec5e4c0512d9b5bce1747bb5.', STARTKEY => '', ENDKEY => ''}] 2023-12-21 17:56:36,112 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2023-12-21 17:56:36,112 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1703181396112"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:36,113 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2023-12-21 17:56:36,116 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2023-12-21 17:56:36,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 66 msec 2023-12-21 17:56:36,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2023-12-21 17:56:36,314 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2023-12-21 17:56:36,314 INFO [Listener at localhost/38251] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2023-12-21 17:56:36,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2023-12-21 17:56:36,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2023-12-21 17:56:36,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2023-12-21 17:56:36,320 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181396319"}]},"ts":"1703181396319"} 2023-12-21 17:56:36,321 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2023-12-21 17:56:36,323 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2023-12-21 17:56:36,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7fb03dd6cd42248fc7ec0a182142c765, UNASSIGN}] 2023-12-21 17:56:36,325 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7fb03dd6cd42248fc7ec0a182142c765, UNASSIGN 2023-12-21 17:56:36,326 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=7fb03dd6cd42248fc7ec0a182142c765, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:36,326 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181396326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181396326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181396326"}]},"ts":"1703181396326"} 2023-12-21 17:56:36,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 7fb03dd6cd42248fc7ec0a182142c765, server=jenkins-hbase4.apache.org,36257,1703181329103}] 2023-12-21 17:56:36,479 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:36,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:56:36,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7fb03dd6cd42248fc7ec0a182142c765, disabling compactions & flushes 2023-12-21 17:56:36,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:56:36,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:56:36,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. after waiting 0 ms 2023-12-21 17:56:36,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:56:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-12-21 17:56:36,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765. 2023-12-21 17:56:36,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7fb03dd6cd42248fc7ec0a182142c765: 2023-12-21 17:56:36,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:56:36,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=7fb03dd6cd42248fc7ec0a182142c765, regionState=CLOSED 2023-12-21 17:56:36,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181396493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181396493"}]},"ts":"1703181396493"} 2023-12-21 17:56:36,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2023-12-21 17:56:36,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 7fb03dd6cd42248fc7ec0a182142c765, server=jenkins-hbase4.apache.org,36257,1703181329103 in 168 msec 2023-12-21 17:56:36,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2023-12-21 17:56:36,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7fb03dd6cd42248fc7ec0a182142c765, UNASSIGN in 173 msec 2023-12-21 17:56:36,500 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181396499"}]},"ts":"1703181396499"} 2023-12-21 17:56:36,501 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2023-12-21 17:56:36,504 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2023-12-21 17:56:36,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 190 msec 2023-12-21 17:56:36,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2023-12-21 17:56:36,570 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2023-12-21 17:56:36,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2023-12-21 17:56:36,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2023-12-21 17:56:36,574 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2023-12-21 17:56:36,574 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2023-12-21 17:56:36,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2023-12-21 17:56:36,579 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:56:36,581 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765/cf, FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765/recovered.edits] 2023-12-21 17:56:36,588 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765/recovered.edits/4.seqid to hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/archive/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765/recovered.edits/4.seqid 2023-12-21 17:56:36,589 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin1/7fb03dd6cd42248fc7ec0a182142c765 2023-12-21 17:56:36,589 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2023-12-21 17:56:36,593 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2023-12-21 17:56:36,594 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2023-12-21 17:56:36,597 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2023-12-21 17:56:36,598 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2023-12-21 17:56:36,598 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2023-12-21 17:56:36,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1703181396598"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:36,599 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-12-21 17:56:36,600 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7fb03dd6cd42248fc7ec0a182142c765, NAME => 'TestQuotaAdmin1,,1703181333194.7fb03dd6cd42248fc7ec0a182142c765.', STARTKEY => '', ENDKEY => ''}] 2023-12-21 17:56:36,600 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2023-12-21 17:56:36,600 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1703181396600"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:36,601 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2023-12-21 17:56:36,604 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2023-12-21 17:56:36,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 33 msec 2023-12-21 17:56:36,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2023-12-21 17:56:36,827 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2023-12-21 17:56:36,828 INFO [Listener at localhost/38251] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2023-12-21 17:56:36,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2023-12-21 17:56:36,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2023-12-21 17:56:36,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-12-21 17:56:36,833 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181396833"}]},"ts":"1703181396833"} 2023-12-21 17:56:36,835 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2023-12-21 17:56:36,837 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2023-12-21 17:56:36,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=5cda864da99e60a937985483488e3d70, UNASSIGN}] 2023-12-21 17:56:36,838 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=5cda864da99e60a937985483488e3d70, UNASSIGN 2023-12-21 17:56:36,839 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5cda864da99e60a937985483488e3d70, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:36,839 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181396839"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181396839"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181396839"}]},"ts":"1703181396839"} 2023-12-21 17:56:36,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 5cda864da99e60a937985483488e3d70, server=jenkins-hbase4.apache.org,36257,1703181329103}] 2023-12-21 17:56:36,992 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:36,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5cda864da99e60a937985483488e3d70 2023-12-21 17:56:36,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5cda864da99e60a937985483488e3d70, disabling compactions & flushes 2023-12-21 17:56:36,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:56:36,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:56:36,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. after waiting 0 ms 2023-12-21 17:56:36,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:56:36,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-12-21 17:56:37,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70. 2023-12-21 17:56:37,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5cda864da99e60a937985483488e3d70: 2023-12-21 17:56:37,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5cda864da99e60a937985483488e3d70 2023-12-21 17:56:37,002 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5cda864da99e60a937985483488e3d70, regionState=CLOSED 2023-12-21 17:56:37,003 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1703181397002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181397002"}]},"ts":"1703181397002"} 2023-12-21 17:56:37,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2023-12-21 17:56:37,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 5cda864da99e60a937985483488e3d70, server=jenkins-hbase4.apache.org,36257,1703181329103 in 163 msec 2023-12-21 17:56:37,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2023-12-21 17:56:37,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=5cda864da99e60a937985483488e3d70, UNASSIGN in 169 msec 2023-12-21 17:56:37,008 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181397008"}]},"ts":"1703181397008"} 2023-12-21 17:56:37,009 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2023-12-21 17:56:37,011 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2023-12-21 17:56:37,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 184 msec 2023-12-21 17:56:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-12-21 17:56:37,083 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2023-12-21 17:56:37,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2023-12-21 17:56:37,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2023-12-21 17:56:37,087 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2023-12-21 17:56:37,087 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2023-12-21 17:56:37,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2023-12-21 17:56:37,091 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70 2023-12-21 17:56:37,094 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70/cf, FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70/recovered.edits] 2023-12-21 17:56:37,101 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70/recovered.edits/4.seqid to hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/archive/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70/recovered.edits/4.seqid 2023-12-21 17:56:37,101 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/default/TestQuotaAdmin2/5cda864da99e60a937985483488e3d70 2023-12-21 17:56:37,101 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2023-12-21 17:56:37,104 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2023-12-21 17:56:37,106 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2023-12-21 17:56:37,108 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2023-12-21 17:56:37,109 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2023-12-21 17:56:37,109 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2023-12-21 17:56:37,109 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1703181397109"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:37,111 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-12-21 17:56:37,111 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5cda864da99e60a937985483488e3d70, NAME => 'TestQuotaAdmin2,,1703181333993.5cda864da99e60a937985483488e3d70.', STARTKEY => '', ENDKEY => ''}] 2023-12-21 17:56:37,111 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2023-12-21 17:56:37,111 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1703181397111"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:37,112 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2023-12-21 17:56:37,115 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2023-12-21 17:56:37,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 31 msec 2023-12-21 17:56:37,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2023-12-21 17:56:37,340 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2023-12-21 17:56:37,341 INFO [Listener at localhost/38251] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2023-12-21 17:56:37,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2023-12-21 17:56:37,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2023-12-21 17:56:37,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-12-21 17:56:37,345 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181397345"}]},"ts":"1703181397345"} 2023-12-21 17:56:37,347 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2023-12-21 17:56:37,349 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2023-12-21 17:56:37,350 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=c53a85d93f67d403f656bb1f7e9c31c0, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=6c0133667c0062bff6162229a73525fc, UNASSIGN}] 2023-12-21 17:56:37,351 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=c53a85d93f67d403f656bb1f7e9c31c0, UNASSIGN 2023-12-21 17:56:37,351 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=6c0133667c0062bff6162229a73525fc, UNASSIGN 2023-12-21 17:56:37,351 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=6c0133667c0062bff6162229a73525fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:37,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c53a85d93f67d403f656bb1f7e9c31c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:56:37,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181397351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181397351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181397351"}]},"ts":"1703181397351"} 2023-12-21 17:56:37,352 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181397351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1703181397351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1703181397351"}]},"ts":"1703181397351"} 2023-12-21 17:56:37,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure 6c0133667c0062bff6162229a73525fc, server=jenkins-hbase4.apache.org,36257,1703181329103}] 2023-12-21 17:56:37,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure c53a85d93f67d403f656bb1f7e9c31c0, server=jenkins-hbase4.apache.org,34957,1703181329156}] 2023-12-21 17:56:37,505 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:37,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6c0133667c0062bff6162229a73525fc 2023-12-21 17:56:37,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6c0133667c0062bff6162229a73525fc, disabling compactions & flushes 2023-12-21 17:56:37,506 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:56:37,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:56:37,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:56:37,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. after waiting 0 ms 2023-12-21 17:56:37,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:56:37,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:56:37,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c53a85d93f67d403f656bb1f7e9c31c0, disabling compactions & flushes 2023-12-21 17:56:37,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:56:37,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:56:37,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. after waiting 0 ms 2023-12-21 17:56:37,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:56:37,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-12-21 17:56:37,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-12-21 17:56:37,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc. 2023-12-21 17:56:37,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6c0133667c0062bff6162229a73525fc: 2023-12-21 17:56:37,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0. 2023-12-21 17:56:37,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c53a85d93f67d403f656bb1f7e9c31c0: 2023-12-21 17:56:37,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6c0133667c0062bff6162229a73525fc 2023-12-21 17:56:37,516 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=6c0133667c0062bff6162229a73525fc, regionState=CLOSED 2023-12-21 17:56:37,516 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181397515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181397515"}]},"ts":"1703181397515"} 2023-12-21 17:56:37,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:56:37,516 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c53a85d93f67d403f656bb1f7e9c31c0, regionState=CLOSED 2023-12-21 17:56:37,516 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1703181397516"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1703181397516"}]},"ts":"1703181397516"} 2023-12-21 17:56:37,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2023-12-21 17:56:37,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure 6c0133667c0062bff6162229a73525fc, server=jenkins-hbase4.apache.org,36257,1703181329103 in 164 msec 2023-12-21 17:56:37,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2023-12-21 17:56:37,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure c53a85d93f67d403f656bb1f7e9c31c0, server=jenkins-hbase4.apache.org,34957,1703181329156 in 164 msec 2023-12-21 17:56:37,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=6c0133667c0062bff6162229a73525fc, UNASSIGN in 169 msec 2023-12-21 17:56:37,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2023-12-21 17:56:37,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=c53a85d93f67d403f656bb1f7e9c31c0, UNASSIGN in 170 msec 2023-12-21 17:56:37,522 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1703181397522"}]},"ts":"1703181397522"} 2023-12-21 17:56:37,523 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2023-12-21 17:56:37,526 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2023-12-21 17:56:37,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 185 msec 2023-12-21 17:56:37,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-12-21 17:56:37,596 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2023-12-21 17:56:37,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2023-12-21 17:56:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2023-12-21 17:56:37,599 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2023-12-21 17:56:37,600 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2023-12-21 17:56:37,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2023-12-21 17:56:37,605 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:56:37,605 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc 2023-12-21 17:56:37,607 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0/cf, FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0/recovered.edits] 2023-12-21 17:56:37,607 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc/cf, FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc/recovered.edits] 2023-12-21 17:56:37,613 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0/recovered.edits/4.seqid to hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/archive/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0/recovered.edits/4.seqid 2023-12-21 17:56:37,614 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc/recovered.edits/4.seqid to hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/archive/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc/recovered.edits/4.seqid 2023-12-21 17:56:37,614 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/c53a85d93f67d403f656bb1f7e9c31c0 2023-12-21 17:56:37,614 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/.tmp/data/TestNs/TestTable/6c0133667c0062bff6162229a73525fc 2023-12-21 17:56:37,614 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2023-12-21 17:56:37,617 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2023-12-21 17:56:37,619 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2023-12-21 17:56:37,620 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2023-12-21 17:56:37,621 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2023-12-21 17:56:37,621 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2023-12-21 17:56:37,622 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1703181397622"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:37,622 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1703181397622"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:37,623 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-12-21 17:56:37,623 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c53a85d93f67d403f656bb1f7e9c31c0, NAME => 'TestNs:TestTable,,1703181335062.c53a85d93f67d403f656bb1f7e9c31c0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6c0133667c0062bff6162229a73525fc, NAME => 'TestNs:TestTable,1,1703181335062.6c0133667c0062bff6162229a73525fc.', STARTKEY => '1', ENDKEY => ''}] 2023-12-21 17:56:37,623 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2023-12-21 17:56:37,623 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1703181397623"}]},"ts":"9223372036854775807"} 2023-12-21 17:56:37,625 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2023-12-21 17:56:37,628 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2023-12-21 17:56:37,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 31 msec 2023-12-21 17:56:37,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2023-12-21 17:56:37,853 INFO [Listener at localhost/38251] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2023-12-21 17:56:37,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2023-12-21 17:56:37,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2023-12-21 17:56:37,865 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2023-12-21 17:56:37,868 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2023-12-21 17:56:37,870 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2023-12-21 17:56:37,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2023-12-21 17:56:37,873 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2023-12-21 17:56:37,873 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-12-21 17:56:37,873 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2023-12-21 17:56:37,875 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2023-12-21 17:56:37,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 19 msec 2023-12-21 17:56:38,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34749] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2023-12-21 17:56:38,121 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-12-21 17:56:38,122 INFO [Listener at localhost/38251] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-21 17:56:38,122 DEBUG [Listener at localhost/38251] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b937afe to 127.0.0.1:57949 2023-12-21 17:56:38,122 DEBUG [Listener at localhost/38251] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-21 17:56:38,123 DEBUG [Listener at localhost/38251] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-12-21 17:56:38,123 DEBUG [Listener at localhost/38251] util.JVMClusterUtil(257): Found active master hash=1805281407, stopped=false 2023-12-21 17:56:38,123 DEBUG [Listener at localhost/38251] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-12-21 17:56:38,123 INFO [Listener at localhost/38251] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:56:38,126 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-12-21 17:56:38,126 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-12-21 17:56:38,126 INFO [Listener at localhost/38251] procedure2.ProcedureExecutor(675): Stopping 2023-12-21 17:56:38,126 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:56:38,126 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-12-21 17:56:38,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-21 17:56:38,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-21 17:56:38,127 DEBUG [Listener at localhost/38251] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fa611e8 to 127.0.0.1:57949 2023-12-21 17:56:38,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-12-21 17:56:38,127 DEBUG [Listener at localhost/38251] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-21 17:56:38,127 INFO [Listener at localhost/38251] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,36257,1703181329103' ***** 2023-12-21 17:56:38,127 INFO [Listener at localhost/38251] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2023-12-21 17:56:38,127 INFO [Listener at localhost/38251] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,34957,1703181329156' ***** 2023-12-21 17:56:38,127 INFO [Listener at localhost/38251] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2023-12-21 17:56:38,127 INFO [RS:0;jenkins-hbase4:36257] regionserver.HeapMemoryManager(220): Stopping 2023-12-21 17:56:38,127 INFO [RS:1;jenkins-hbase4:34957] regionserver.HeapMemoryManager(220): Stopping 2023-12-21 17:56:38,128 INFO [RS:1;jenkins-hbase4:34957] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-12-21 17:56:38,128 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-12-21 17:56:38,128 INFO [RS:1;jenkins-hbase4:34957] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-12-21 17:56:38,128 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-12-21 17:56:38,128 INFO [RS:0;jenkins-hbase4:36257] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-12-21 17:56:38,128 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(3308): Received CLOSE for 915c845507b102bd66e09247defe05c0 2023-12-21 17:56:38,128 INFO [RS:0;jenkins-hbase4:36257] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-12-21 17:56:38,128 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-12-21 17:56:38,128 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:38,128 INFO [RS:0;jenkins-hbase4:36257] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-21 17:56:38,128 DEBUG [RS:0;jenkins-hbase4:36257] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7768e20d to 127.0.0.1:57949 2023-12-21 17:56:38,128 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-12-21 17:56:38,128 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(3308): Received CLOSE for 026b594a2ee2a4d720e610685ddd9390 2023-12-21 17:56:38,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 915c845507b102bd66e09247defe05c0, disabling compactions & flushes 2023-12-21 17:56:38,129 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:56:38,128 DEBUG [RS:0;jenkins-hbase4:36257] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-21 17:56:38,129 INFO [RS:1;jenkins-hbase4:34957] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-12-21 17:56:38,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:56:38,129 INFO [RS:0;jenkins-hbase4:36257] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-12-21 17:56:38,129 DEBUG [RS:1;jenkins-hbase4:34957] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64288027 to 127.0.0.1:57949 2023-12-21 17:56:38,130 DEBUG [RS:1;jenkins-hbase4:34957] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-21 17:56:38,130 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2023-12-21 17:56:38,130 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1481): Online Regions={915c845507b102bd66e09247defe05c0=hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0., 026b594a2ee2a4d720e610685ddd9390=hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390.} 2023-12-21 17:56:38,131 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1507): Waiting on 026b594a2ee2a4d720e610685ddd9390, 915c845507b102bd66e09247defe05c0 2023-12-21 17:56:38,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:56:38,129 INFO [RS:0;jenkins-hbase4:36257] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-12-21 17:56:38,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. after waiting 0 ms 2023-12-21 17:56:38,132 INFO [RS:0;jenkins-hbase4:36257] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-12-21 17:56:38,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:56:38,132 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2023-12-21 17:56:38,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 915c845507b102bd66e09247defe05c0 1/1 column families, dataSize=147 B heapSize=704 B 2023-12-21 17:56:38,132 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2023-12-21 17:56:38,132 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-12-21 17:56:38,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-12-21 17:56:38,133 DEBUG [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-12-21 17:56:38,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-12-21 17:56:38,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-12-21 17:56:38,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-12-21 17:56:38,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-12-21 17:56:38,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2023-12-21 17:56:38,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/.tmp/info/c7f3763cb9a843668dd5527f280ce701 2023-12-21 17:56:38,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7f3763cb9a843668dd5527f280ce701 2023-12-21 17:56:38,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/.tmp/rep_barrier/1a8e19052d324905b0cf4a65cff345c2 2023-12-21 17:56:38,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a8e19052d324905b0cf4a65cff345c2 2023-12-21 17:56:38,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/.tmp/table/e47cfa6aaf184a9cb5c0fdce6e7d7f62 2023-12-21 17:56:38,214 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e47cfa6aaf184a9cb5c0fdce6e7d7f62 2023-12-21 17:56:38,215 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/.tmp/info/c7f3763cb9a843668dd5527f280ce701 as hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/info/c7f3763cb9a843668dd5527f280ce701 2023-12-21 17:56:38,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7f3763cb9a843668dd5527f280ce701 2023-12-21 17:56:38,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/info/c7f3763cb9a843668dd5527f280ce701, entries=30, sequenceid=66, filesize=8.0 K 2023-12-21 17:56:38,224 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/.tmp/rep_barrier/1a8e19052d324905b0cf4a65cff345c2 as hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/rep_barrier/1a8e19052d324905b0cf4a65cff345c2 2023-12-21 17:56:38,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a8e19052d324905b0cf4a65cff345c2 2023-12-21 17:56:38,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/rep_barrier/1a8e19052d324905b0cf4a65cff345c2, entries=5, sequenceid=66, filesize=5.3 K 2023-12-21 17:56:38,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/.tmp/table/e47cfa6aaf184a9cb5c0fdce6e7d7f62 as hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/table/e47cfa6aaf184a9cb5c0fdce6e7d7f62 2023-12-21 17:56:38,239 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e47cfa6aaf184a9cb5c0fdce6e7d7f62 2023-12-21 17:56:38,239 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/table/e47cfa6aaf184a9cb5c0fdce6e7d7f62, entries=13, sequenceid=66, filesize=5.6 K 2023-12-21 17:56:38,240 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 107ms, sequenceid=66, compaction requested=false 2023-12-21 17:56:38,249 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2023-12-21 17:56:38,250 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-12-21 17:56:38,250 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-12-21 17:56:38,250 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-12-21 17:56:38,250 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-12-21 17:56:38,332 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1507): Waiting on 026b594a2ee2a4d720e610685ddd9390, 915c845507b102bd66e09247defe05c0 2023-12-21 17:56:38,333 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,36257,1703181329103; all regions closed. 2023-12-21 17:56:38,333 DEBUG [RS:0;jenkins-hbase4:36257] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-12-21 17:56:38,343 DEBUG [RS:0;jenkins-hbase4:36257] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/oldWALs 2023-12-21 17:56:38,343 INFO [RS:0;jenkins-hbase4:36257] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36257%2C1703181329103.meta:.meta(num 1703181330853) 2023-12-21 17:56:38,348 DEBUG [RS:0;jenkins-hbase4:36257] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/oldWALs 2023-12-21 17:56:38,348 INFO [RS:0;jenkins-hbase4:36257] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36257%2C1703181329103:(num 1703181330613) 2023-12-21 17:56:38,348 DEBUG [RS:0;jenkins-hbase4:36257] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-21 17:56:38,348 INFO [RS:0;jenkins-hbase4:36257] regionserver.LeaseManager(133): Closed leases 2023-12-21 17:56:38,349 INFO [RS:0;jenkins-hbase4:36257] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-12-21 17:56:38,349 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-12-21 17:56:38,350 INFO [RS:0;jenkins-hbase4:36257] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36257 2023-12-21 17:56:38,356 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-12-21 17:56:38,356 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:38,356 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36257,1703181329103 2023-12-21 17:56:38,356 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-12-21 17:56:38,356 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-12-21 17:56:38,358 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36257,1703181329103] 2023-12-21 17:56:38,358 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36257,1703181329103; numProcessing=1 2023-12-21 17:56:38,365 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36257,1703181329103 already deleted, retry=false 2023-12-21 17:56:38,365 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,36257,1703181329103 expired; onlineServers=1 2023-12-21 17:56:38,450 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-12-21 17:56:38,450 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-12-21 17:56:38,458 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-21 17:56:38,458 INFO [RS:0;jenkins-hbase4:36257] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,36257,1703181329103; zookeeper connection closed. 2023-12-21 17:56:38,458 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:36257-0x100ab947eba0001, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-21 17:56:38,459 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4cf52e90] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4cf52e90 2023-12-21 17:56:38,532 DEBUG [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1507): Waiting on 026b594a2ee2a4d720e610685ddd9390, 915c845507b102bd66e09247defe05c0 2023-12-21 17:56:38,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0/.tmp/info/9bc3b54605db4014b2911f48ba925f76 2023-12-21 17:56:38,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bc3b54605db4014b2911f48ba925f76 2023-12-21 17:56:38,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0/.tmp/info/9bc3b54605db4014b2911f48ba925f76 as hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0/info/9bc3b54605db4014b2911f48ba925f76 2023-12-21 17:56:38,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bc3b54605db4014b2911f48ba925f76 2023-12-21 17:56:38,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0/info/9bc3b54605db4014b2911f48ba925f76, entries=3, sequenceid=8, filesize=5.0 K 2023-12-21 17:56:38,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 915c845507b102bd66e09247defe05c0 in 454ms, sequenceid=8, compaction requested=false 2023-12-21 17:56:38,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/namespace/915c845507b102bd66e09247defe05c0/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2023-12-21 17:56:38,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:56:38,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 915c845507b102bd66e09247defe05c0: 2023-12-21 17:56:38,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1703181331104.915c845507b102bd66e09247defe05c0. 2023-12-21 17:56:38,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 026b594a2ee2a4d720e610685ddd9390, disabling compactions & flushes 2023-12-21 17:56:38,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:56:38,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:56:38,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. after waiting 0 ms 2023-12-21 17:56:38,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:56:38,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 026b594a2ee2a4d720e610685ddd9390 2/2 column families, dataSize=726 B heapSize=2.44 KB 2023-12-21 17:56:38,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/.tmp/q/d23395d2b0f44e7fa45e2fa110a8d4cf 2023-12-21 17:56:38,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d23395d2b0f44e7fa45e2fa110a8d4cf 2023-12-21 17:56:38,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/.tmp/u/263de417c15045b49e30065d19ac0424 2023-12-21 17:56:38,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 263de417c15045b49e30065d19ac0424 2023-12-21 17:56:38,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/.tmp/q/d23395d2b0f44e7fa45e2fa110a8d4cf as hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/q/d23395d2b0f44e7fa45e2fa110a8d4cf 2023-12-21 17:56:38,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d23395d2b0f44e7fa45e2fa110a8d4cf 2023-12-21 17:56:38,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/q/d23395d2b0f44e7fa45e2fa110a8d4cf, entries=5, sequenceid=17, filesize=5.1 K 2023-12-21 17:56:38,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/.tmp/u/263de417c15045b49e30065d19ac0424 as hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/u/263de417c15045b49e30065d19ac0424 2023-12-21 17:56:38,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 263de417c15045b49e30065d19ac0424 2023-12-21 17:56:38,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/u/263de417c15045b49e30065d19ac0424, entries=4, sequenceid=17, filesize=5.0 K 2023-12-21 17:56:38,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 026b594a2ee2a4d720e610685ddd9390 in 52ms, sequenceid=17, compaction requested=false 2023-12-21 17:56:38,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/data/hbase/quota/026b594a2ee2a4d720e610685ddd9390/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2023-12-21 17:56:38,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:56:38,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 026b594a2ee2a4d720e610685ddd9390: 2023-12-21 17:56:38,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1703181331822.026b594a2ee2a4d720e610685ddd9390. 2023-12-21 17:56:38,732 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,34957,1703181329156; all regions closed. 2023-12-21 17:56:38,732 DEBUG [RS:1;jenkins-hbase4:34957] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-12-21 17:56:38,739 DEBUG [RS:1;jenkins-hbase4:34957] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/oldWALs 2023-12-21 17:56:38,740 INFO [RS:1;jenkins-hbase4:34957] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34957%2C1703181329156:(num 1703181330613) 2023-12-21 17:56:38,740 DEBUG [RS:1;jenkins-hbase4:34957] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-21 17:56:38,740 INFO [RS:1;jenkins-hbase4:34957] regionserver.LeaseManager(133): Closed leases 2023-12-21 17:56:38,740 INFO [RS:1;jenkins-hbase4:34957] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-12-21 17:56:38,741 INFO [RS:1;jenkins-hbase4:34957] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-12-21 17:56:38,741 INFO [RS:1;jenkins-hbase4:34957] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-12-21 17:56:38,741 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-12-21 17:56:38,741 INFO [RS:1;jenkins-hbase4:34957] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-12-21 17:56:38,741 INFO [RS:1;jenkins-hbase4:34957] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34957 2023-12-21 17:56:38,744 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34957,1703181329156 2023-12-21 17:56:38,744 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-12-21 17:56:38,745 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34957,1703181329156] 2023-12-21 17:56:38,746 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34957,1703181329156; numProcessing=2 2023-12-21 17:56:38,747 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34957,1703181329156 already deleted, retry=false 2023-12-21 17:56:38,747 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,34957,1703181329156 expired; onlineServers=0 2023-12-21 17:56:38,747 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,34749,1703181327913' ***** 2023-12-21 17:56:38,747 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2023-12-21 17:56:38,748 DEBUG [M:0;jenkins-hbase4:34749] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23a6c51e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-12-21 17:56:38,748 INFO [M:0;jenkins-hbase4:34749] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,34749,1703181327913 2023-12-21 17:56:38,748 INFO [M:0;jenkins-hbase4:34749] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,34749,1703181327913; all regions closed. 2023-12-21 17:56:38,748 DEBUG [M:0;jenkins-hbase4:34749] ipc.AbstractRpcClient(489): Stopping rpc client 2023-12-21 17:56:38,748 DEBUG [M:0;jenkins-hbase4:34749] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-12-21 17:56:38,749 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-12-21 17:56:38,749 DEBUG [M:0;jenkins-hbase4:34749] cleaner.HFileCleaner(317): Stopping file delete threads 2023-12-21 17:56:38,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1703181330324] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1703181330324,5,FailOnTimeoutGroup] 2023-12-21 17:56:38,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1703181330324] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1703181330324,5,FailOnTimeoutGroup] 2023-12-21 17:56:38,749 INFO [M:0;jenkins-hbase4:34749] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-12-21 17:56:38,749 INFO [M:0;jenkins-hbase4:34749] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-12-21 17:56:38,749 INFO [M:0;jenkins-hbase4:34749] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2023-12-21 17:56:38,749 DEBUG [M:0;jenkins-hbase4:34749] master.HMaster(1517): Stopping service threads 2023-12-21 17:56:38,749 INFO [M:0;jenkins-hbase4:34749] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-12-21 17:56:38,750 ERROR [M:0;jenkins-hbase4:34749] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2023-12-21 17:56:38,750 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-12-21 17:56:38,750 INFO [M:0;jenkins-hbase4:34749] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-12-21 17:56:38,750 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-12-21 17:56:38,750 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-12-21 17:56:38,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-12-21 17:56:38,751 DEBUG [M:0;jenkins-hbase4:34749] zookeeper.ZKUtil(399): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-12-21 17:56:38,751 WARN [M:0;jenkins-hbase4:34749] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-12-21 17:56:38,751 INFO [M:0;jenkins-hbase4:34749] assignment.AssignmentManager(315): Stopping assignment manager 2023-12-21 17:56:38,751 INFO [M:0;jenkins-hbase4:34749] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-12-21 17:56:38,752 DEBUG [M:0;jenkins-hbase4:34749] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-12-21 17:56:38,752 INFO [M:0;jenkins-hbase4:34749] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-21 17:56:38,752 DEBUG [M:0;jenkins-hbase4:34749] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-21 17:56:38,752 DEBUG [M:0;jenkins-hbase4:34749] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-12-21 17:56:38,752 DEBUG [M:0;jenkins-hbase4:34749] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-21 17:56:38,752 INFO [M:0;jenkins-hbase4:34749] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.02 KB heapSize=184.83 KB 2023-12-21 17:56:38,767 INFO [M:0;jenkins-hbase4:34749] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.02 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4a22dc55a71349859fad2e8581c69a57 2023-12-21 17:56:38,772 INFO [M:0;jenkins-hbase4:34749] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a22dc55a71349859fad2e8581c69a57 2023-12-21 17:56:38,773 DEBUG [M:0;jenkins-hbase4:34749] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4a22dc55a71349859fad2e8581c69a57 as hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4a22dc55a71349859fad2e8581c69a57 2023-12-21 17:56:38,779 INFO [M:0;jenkins-hbase4:34749] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a22dc55a71349859fad2e8581c69a57 2023-12-21 17:56:38,779 INFO [M:0;jenkins-hbase4:34749] regionserver.HStore(1080): Added hdfs://localhost:34195/user/jenkins/test-data/a04dd147-8819-8e39-20af-5f3382e21ed0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4a22dc55a71349859fad2e8581c69a57, entries=45, sequenceid=376, filesize=12.0 K 2023-12-21 17:56:38,780 INFO [M:0;jenkins-hbase4:34749] regionserver.HRegion(2948): Finished flush of dataSize ~153.02 KB/156696, heapSize ~184.81 KB/189248, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=376, compaction requested=false 2023-12-21 17:56:38,781 INFO [M:0;jenkins-hbase4:34749] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-12-21 17:56:38,781 DEBUG [M:0;jenkins-hbase4:34749] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-12-21 17:56:38,787 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-12-21 17:56:38,788 INFO [M:0;jenkins-hbase4:34749] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-12-21 17:56:38,788 INFO [M:0;jenkins-hbase4:34749] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34749 2023-12-21 17:56:38,790 DEBUG [M:0;jenkins-hbase4:34749] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34749,1703181327913 already deleted, retry=false 2023-12-21 17:56:38,846 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-21 17:56:38,846 INFO [RS:1;jenkins-hbase4:34957] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,34957,1703181329156; zookeeper connection closed. 2023-12-21 17:56:38,846 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): regionserver:34957-0x100ab947eba0002, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-21 17:56:38,846 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5d5d907e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5d5d907e 2023-12-21 17:56:38,846 INFO [Listener at localhost/38251] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-12-21 17:56:38,892 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-21 17:56:38,892 INFO [M:0;jenkins-hbase4:34749] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,34749,1703181327913; zookeeper connection closed. 2023-12-21 17:56:38,892 DEBUG [Listener at localhost/38251-EventThread] zookeeper.ZKWatcher(600): master:34749-0x100ab947eba0000, quorum=127.0.0.1:57949, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-12-21 17:56:38,894 WARN [Listener at localhost/38251] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-12-21 17:56:38,897 INFO [Listener at localhost/38251] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-12-21 17:56:39,001 WARN [BP-1402431673-172.31.14.131-1703181324833 heartbeating to localhost/127.0.0.1:34195] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-12-21 17:56:39,001 WARN [BP-1402431673-172.31.14.131-1703181324833 heartbeating to localhost/127.0.0.1:34195] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1402431673-172.31.14.131-1703181324833 (Datanode Uuid 5e3865ed-661c-4a19-b580-508c65600503) service to localhost/127.0.0.1:34195 2023-12-21 17:56:39,003 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/cluster_156f09d0-dff3-4911-ef84-9605a394b831/dfs/data/data3/current/BP-1402431673-172.31.14.131-1703181324833] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-12-21 17:56:39,003 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/cluster_156f09d0-dff3-4911-ef84-9605a394b831/dfs/data/data4/current/BP-1402431673-172.31.14.131-1703181324833] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-12-21 17:56:39,004 WARN [Listener at localhost/38251] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-12-21 17:56:39,006 INFO [Listener at localhost/38251] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-12-21 17:56:39,110 WARN [BP-1402431673-172.31.14.131-1703181324833 heartbeating to localhost/127.0.0.1:34195] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-12-21 17:56:39,110 WARN [BP-1402431673-172.31.14.131-1703181324833 heartbeating to localhost/127.0.0.1:34195] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1402431673-172.31.14.131-1703181324833 (Datanode Uuid 1f06efff-de88-457c-9bf9-e44dac648d92) service to localhost/127.0.0.1:34195 2023-12-21 17:56:39,111 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/cluster_156f09d0-dff3-4911-ef84-9605a394b831/dfs/data/data1/current/BP-1402431673-172.31.14.131-1703181324833] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-12-21 17:56:39,111 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a50e906d-3eaa-0678-67f1-e2999438a59c/cluster_156f09d0-dff3-4911-ef84-9605a394b831/dfs/data/data2/current/BP-1402431673-172.31.14.131-1703181324833] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-12-21 17:56:39,148 INFO [Listener at localhost/38251] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-12-21 17:56:39,262 INFO [Listener at localhost/38251] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-12-21 17:56:39,305 INFO [Listener at localhost/38251] hbase.HBaseTestingUtility(1293): Minicluster is down