2023-07-18 18:14:22,472 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1 2023-07-18 18:14:22,494 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1 timeout: 13 mins 2023-07-18 18:14:22,513 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 18:14:22,514 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e, deleteOnExit=true 2023-07-18 18:14:22,514 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 18:14:22,515 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/test.cache.data in system properties and HBase conf 2023-07-18 18:14:22,515 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 18:14:22,516 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir in system properties and HBase conf 2023-07-18 18:14:22,517 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 18:14:22,517 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 18:14:22,517 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 18:14:22,639 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-18 18:14:23,054 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 18:14:23,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:14:23,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:14:23,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 18:14:23,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:14:23,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 18:14:23,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 18:14:23,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:14:23,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:14:23,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 18:14:23,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/nfs.dump.dir in system properties and HBase conf 2023-07-18 18:14:23,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir in system properties and HBase conf 2023-07-18 18:14:23,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:14:23,063 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 18:14:23,064 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 18:14:23,679 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:14:23,685 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:14:24,003 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-18 18:14:24,168 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-18 18:14:24,182 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:14:24,218 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:14:24,251 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/Jetty_localhost_36775_hdfs____.xwcr44/webapp 2023-07-18 18:14:24,387 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36775 2023-07-18 18:14:24,399 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:14:24,399 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:14:24,885 WARN [Listener at localhost/46377] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:14:24,978 WARN [Listener at localhost/46377] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:14:24,995 WARN [Listener at localhost/46377] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:14:25,000 INFO [Listener at localhost/46377] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:14:25,010 INFO [Listener at localhost/46377] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/Jetty_localhost_40315_datanode____.fptzwe/webapp 2023-07-18 18:14:25,109 INFO [Listener at localhost/46377] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40315 2023-07-18 18:14:25,544 WARN [Listener at localhost/39679] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:14:25,558 WARN [Listener at localhost/39679] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:14:25,562 WARN [Listener at localhost/39679] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:14:25,565 INFO [Listener at localhost/39679] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:14:25,580 INFO [Listener at localhost/39679] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/Jetty_localhost_37747_datanode____.w9eeir/webapp 2023-07-18 18:14:25,715 INFO [Listener at localhost/39679] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37747 2023-07-18 18:14:25,738 WARN [Listener at localhost/46259] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:14:25,782 WARN [Listener at localhost/46259] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:14:25,786 WARN [Listener at localhost/46259] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:14:25,789 INFO [Listener at localhost/46259] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:14:25,798 INFO [Listener at localhost/46259] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/Jetty_localhost_34445_datanode____.zppb9/webapp 2023-07-18 18:14:26,025 INFO [Listener at localhost/46259] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34445 2023-07-18 18:14:26,067 WARN [Listener at localhost/35951] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:14:26,209 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x518864de9192d703: Processing first storage report for DS-9f74f898-ef48-42cd-b652-bd68001cb39b from datanode 673eccaf-a708-44dc-9800-fa302ef433e7 2023-07-18 18:14:26,211 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x518864de9192d703: from storage DS-9f74f898-ef48-42cd-b652-bd68001cb39b node DatanodeRegistration(127.0.0.1:36517, datanodeUuid=673eccaf-a708-44dc-9800-fa302ef433e7, infoPort=44983, infoSecurePort=0, ipcPort=39679, storageInfo=lv=-57;cid=testClusterID;nsid=1602333668;c=1689704063768), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-18 18:14:26,212 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f8d54c955c28c53: Processing first storage report for DS-da902ba0-a8f3-44ab-b960-eb890394269f from datanode 89463cbd-8177-4d6f-8e0e-d11a043c7fb8 2023-07-18 18:14:26,212 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f8d54c955c28c53: from storage DS-da902ba0-a8f3-44ab-b960-eb890394269f node DatanodeRegistration(127.0.0.1:36519, datanodeUuid=89463cbd-8177-4d6f-8e0e-d11a043c7fb8, infoPort=39199, infoSecurePort=0, ipcPort=46259, storageInfo=lv=-57;cid=testClusterID;nsid=1602333668;c=1689704063768), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:26,212 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x518864de9192d703: Processing first storage report for DS-d6c79ef1-3dff-4306-a1f1-31ba98bb81c7 from datanode 673eccaf-a708-44dc-9800-fa302ef433e7 2023-07-18 18:14:26,212 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x518864de9192d703: from storage DS-d6c79ef1-3dff-4306-a1f1-31ba98bb81c7 node DatanodeRegistration(127.0.0.1:36517, datanodeUuid=673eccaf-a708-44dc-9800-fa302ef433e7, infoPort=44983, infoSecurePort=0, ipcPort=39679, storageInfo=lv=-57;cid=testClusterID;nsid=1602333668;c=1689704063768), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:26,212 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f8d54c955c28c53: Processing first storage report for DS-4d5ea792-a439-41fd-bfe7-f1149710c434 from datanode 89463cbd-8177-4d6f-8e0e-d11a043c7fb8 2023-07-18 18:14:26,213 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f8d54c955c28c53: from storage DS-4d5ea792-a439-41fd-bfe7-f1149710c434 node DatanodeRegistration(127.0.0.1:36519, datanodeUuid=89463cbd-8177-4d6f-8e0e-d11a043c7fb8, infoPort=39199, infoSecurePort=0, ipcPort=46259, storageInfo=lv=-57;cid=testClusterID;nsid=1602333668;c=1689704063768), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:26,215 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4541df95c02ce5ab: Processing first storage report for DS-2434a5f0-4978-4882-9122-7a16f314a7cc from datanode 04e0b4bf-a58d-486e-8378-1dc8535ea936 2023-07-18 18:14:26,215 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4541df95c02ce5ab: from storage DS-2434a5f0-4978-4882-9122-7a16f314a7cc node DatanodeRegistration(127.0.0.1:34597, datanodeUuid=04e0b4bf-a58d-486e-8378-1dc8535ea936, infoPort=37821, infoSecurePort=0, ipcPort=35951, storageInfo=lv=-57;cid=testClusterID;nsid=1602333668;c=1689704063768), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:26,215 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4541df95c02ce5ab: Processing first storage report for DS-35313f52-1ba7-480d-aef7-d3ad592bb70d from datanode 04e0b4bf-a58d-486e-8378-1dc8535ea936 2023-07-18 18:14:26,215 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4541df95c02ce5ab: from storage DS-35313f52-1ba7-480d-aef7-d3ad592bb70d node DatanodeRegistration(127.0.0.1:34597, datanodeUuid=04e0b4bf-a58d-486e-8378-1dc8535ea936, infoPort=37821, infoSecurePort=0, ipcPort=35951, storageInfo=lv=-57;cid=testClusterID;nsid=1602333668;c=1689704063768), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:26,452 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1 2023-07-18 18:14:26,566 INFO [Listener at localhost/35951] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/zookeeper_0, clientPort=53006, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 18:14:26,581 INFO [Listener at localhost/35951] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53006 2023-07-18 18:14:26,592 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:26,594 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:27,275 INFO [Listener at localhost/35951] util.FSUtils(471): Created version file at hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c with version=8 2023-07-18 18:14:27,275 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/hbase-staging 2023-07-18 18:14:27,283 DEBUG [Listener at localhost/35951] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-18 18:14:27,283 DEBUG [Listener at localhost/35951] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-18 18:14:27,283 DEBUG [Listener at localhost/35951] hbase.LocalHBaseCluster(151): Setting RS InfoServer Port to random. 2023-07-18 18:14:27,283 DEBUG [Listener at localhost/35951] hbase.LocalHBaseCluster(159): Setting Master InfoServer Port to random. 2023-07-18 18:14:27,640 INFO [Listener at localhost/35951] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-18 18:14:28,176 INFO [Listener at localhost/35951] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:28,221 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:28,222 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:28,222 INFO [Listener at localhost/35951] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:28,223 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:28,223 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:28,384 INFO [Listener at localhost/35951] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:28,482 DEBUG [Listener at localhost/35951] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-18 18:14:28,597 INFO [Listener at localhost/35951] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43777 2023-07-18 18:14:28,610 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:28,611 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:28,641 INFO [Listener at localhost/35951] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43777 connecting to ZooKeeper ensemble=127.0.0.1:53006 2023-07-18 18:14:28,695 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:437770x0, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:28,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43777-0x10179a470da0000 connected 2023-07-18 18:14:28,735 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:28,737 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:28,742 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:28,753 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43777 2023-07-18 18:14:28,753 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43777 2023-07-18 18:14:28,754 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43777 2023-07-18 18:14:28,758 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43777 2023-07-18 18:14:28,759 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43777 2023-07-18 18:14:28,792 INFO [Listener at localhost/35951] log.Log(170): Logging initialized @7068ms to org.apache.hbase.thirdparty.org.eclipse.jetty.util.log.Slf4jLog 2023-07-18 18:14:28,929 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:28,930 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:28,931 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:28,934 INFO [Listener at localhost/35951] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-18 18:14:28,934 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:28,934 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:28,939 INFO [Listener at localhost/35951] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:29,009 INFO [Listener at localhost/35951] http.HttpServer(1146): Jetty bound to port 44795 2023-07-18 18:14:29,011 INFO [Listener at localhost/35951] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:29,051 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,055 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@966e0ef{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:29,056 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,056 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@5310d071{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:29,252 INFO [Listener at localhost/35951] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:29,266 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:29,266 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:29,269 INFO [Listener at localhost/35951] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:29,276 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,311 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@9ca6b1f{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/jetty-0_0_0_0-44795-hbase-server-2_4_18-SNAPSHOT_jar-_-any-6758642903397085263/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-18 18:14:29,329 INFO [Listener at localhost/35951] server.AbstractConnector(333): Started ServerConnector@668fa014{HTTP/1.1, (http/1.1)}{0.0.0.0:44795} 2023-07-18 18:14:29,330 INFO [Listener at localhost/35951] server.Server(415): Started @7606ms 2023-07-18 18:14:29,334 INFO [Listener at localhost/35951] master.HMaster(444): hbase.rootdir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c, hbase.cluster.distributed=false 2023-07-18 18:14:29,418 INFO [Listener at localhost/35951] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:29,418 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,419 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,419 INFO [Listener at localhost/35951] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:29,419 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,419 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:29,426 INFO [Listener at localhost/35951] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:29,430 INFO [Listener at localhost/35951] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43237 2023-07-18 18:14:29,432 INFO [Listener at localhost/35951] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:14:29,441 DEBUG [Listener at localhost/35951] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:14:29,442 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:29,444 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:29,447 INFO [Listener at localhost/35951] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43237 connecting to ZooKeeper ensemble=127.0.0.1:53006 2023-07-18 18:14:29,453 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:432370x0, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:29,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43237-0x10179a470da0001 connected 2023-07-18 18:14:29,455 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:29,457 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:29,458 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:29,458 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43237 2023-07-18 18:14:29,462 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43237 2023-07-18 18:14:29,463 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43237 2023-07-18 18:14:29,464 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43237 2023-07-18 18:14:29,464 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43237 2023-07-18 18:14:29,467 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:29,467 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:29,467 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:29,468 INFO [Listener at localhost/35951] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:14:29,468 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:29,468 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:29,468 INFO [Listener at localhost/35951] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:29,470 INFO [Listener at localhost/35951] http.HttpServer(1146): Jetty bound to port 43889 2023-07-18 18:14:29,470 INFO [Listener at localhost/35951] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:29,477 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,478 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@249e2011{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:29,478 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,478 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@6a6a072{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:29,612 INFO [Listener at localhost/35951] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:29,614 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:29,614 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:29,615 INFO [Listener at localhost/35951] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:29,618 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,623 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@2a1b55bd{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/jetty-0_0_0_0-43889-hbase-server-2_4_18-SNAPSHOT_jar-_-any-6214299906547309713/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:29,625 INFO [Listener at localhost/35951] server.AbstractConnector(333): Started ServerConnector@4cab7999{HTTP/1.1, (http/1.1)}{0.0.0.0:43889} 2023-07-18 18:14:29,626 INFO [Listener at localhost/35951] server.Server(415): Started @7902ms 2023-07-18 18:14:29,645 INFO [Listener at localhost/35951] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:29,645 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,645 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,646 INFO [Listener at localhost/35951] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:29,646 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,646 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:29,646 INFO [Listener at localhost/35951] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:29,649 INFO [Listener at localhost/35951] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46845 2023-07-18 18:14:29,650 INFO [Listener at localhost/35951] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:14:29,658 DEBUG [Listener at localhost/35951] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:14:29,660 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:29,662 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:29,663 INFO [Listener at localhost/35951] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46845 connecting to ZooKeeper ensemble=127.0.0.1:53006 2023-07-18 18:14:29,674 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:468450x0, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:29,675 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:468450x0, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:29,677 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:468450x0, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:29,678 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:468450x0, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:29,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46845-0x10179a470da0002 connected 2023-07-18 18:14:29,679 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46845 2023-07-18 18:14:29,679 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46845 2023-07-18 18:14:29,680 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46845 2023-07-18 18:14:29,683 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46845 2023-07-18 18:14:29,683 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46845 2023-07-18 18:14:29,686 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:29,686 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:29,686 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:29,687 INFO [Listener at localhost/35951] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:14:29,687 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:29,687 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:29,687 INFO [Listener at localhost/35951] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:29,688 INFO [Listener at localhost/35951] http.HttpServer(1146): Jetty bound to port 41609 2023-07-18 18:14:29,688 INFO [Listener at localhost/35951] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:29,698 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,698 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2afce463{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:29,699 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,699 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@5ec386b4{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:29,833 INFO [Listener at localhost/35951] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:29,834 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:29,834 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:29,835 INFO [Listener at localhost/35951] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:29,836 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,837 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@4d520d27{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/jetty-0_0_0_0-41609-hbase-server-2_4_18-SNAPSHOT_jar-_-any-1209373708364694203/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:29,838 INFO [Listener at localhost/35951] server.AbstractConnector(333): Started ServerConnector@72b0dcfa{HTTP/1.1, (http/1.1)}{0.0.0.0:41609} 2023-07-18 18:14:29,838 INFO [Listener at localhost/35951] server.Server(415): Started @8114ms 2023-07-18 18:14:29,851 INFO [Listener at localhost/35951] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:29,851 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,851 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,851 INFO [Listener at localhost/35951] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:29,851 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:29,851 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:29,851 INFO [Listener at localhost/35951] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:29,853 INFO [Listener at localhost/35951] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36811 2023-07-18 18:14:29,854 INFO [Listener at localhost/35951] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:14:29,855 DEBUG [Listener at localhost/35951] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:14:29,857 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:29,859 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:29,861 INFO [Listener at localhost/35951] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36811 connecting to ZooKeeper ensemble=127.0.0.1:53006 2023-07-18 18:14:29,866 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:368110x0, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:29,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36811-0x10179a470da0003 connected 2023-07-18 18:14:29,868 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:29,869 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:29,869 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:29,870 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36811 2023-07-18 18:14:29,870 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36811 2023-07-18 18:14:29,875 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36811 2023-07-18 18:14:29,875 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36811 2023-07-18 18:14:29,875 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36811 2023-07-18 18:14:29,878 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:29,878 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:29,878 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:29,879 INFO [Listener at localhost/35951] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:14:29,879 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:29,879 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:29,879 INFO [Listener at localhost/35951] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:29,880 INFO [Listener at localhost/35951] http.HttpServer(1146): Jetty bound to port 33041 2023-07-18 18:14:29,880 INFO [Listener at localhost/35951] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:29,883 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,883 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@477c886b{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:29,883 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:29,884 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@5526bfb1{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:30,003 INFO [Listener at localhost/35951] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:30,004 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:30,005 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:30,005 INFO [Listener at localhost/35951] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:30,006 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:30,007 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@36c7be16{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/jetty-0_0_0_0-33041-hbase-server-2_4_18-SNAPSHOT_jar-_-any-5218314767858355624/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:30,009 INFO [Listener at localhost/35951] server.AbstractConnector(333): Started ServerConnector@58b8c90a{HTTP/1.1, (http/1.1)}{0.0.0.0:33041} 2023-07-18 18:14:30,009 INFO [Listener at localhost/35951] server.Server(415): Started @8285ms 2023-07-18 18:14:30,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:30,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@256662d9{HTTP/1.1, (http/1.1)}{0.0.0.0:32969} 2023-07-18 18:14:30,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(415): Started @8298ms 2023-07-18 18:14:30,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:30,033 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:14:30,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:30,056 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:30,056 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:30,056 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:30,056 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:30,057 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:30,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:14:30,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43777,1689704067457 from backup master directory 2023-07-18 18:14:30,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:14:30,066 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:30,066 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:14:30,067 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:30,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:30,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-18 18:14:30,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-18 18:14:30,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/hbase.id with ID: 911f5b62-2018-4aaf-97ae-f83d1d743503 2023-07-18 18:14:30,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:30,250 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:30,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0f728771 to 127.0.0.1:53006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:30,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c5db0ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:30,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:30,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 18:14:30,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-18 18:14:30,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-18 18:14:30,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:14:30,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:14:30,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:30,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store-tmp 2023-07-18 18:14:30,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:30,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:14:30,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:30,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:30,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:14:30,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:30,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:30,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:14:30,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/WALs/jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:30,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43777%2C1689704067457, suffix=, logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/WALs/jenkins-hbase4.apache.org,43777,1689704067457, archiveDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/oldWALs, maxLogs=10 2023-07-18 18:14:30,554 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK] 2023-07-18 18:14:30,554 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK] 2023-07-18 18:14:30,554 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK] 2023-07-18 18:14:30,562 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:14:30,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/WALs/jenkins-hbase4.apache.org,43777,1689704067457/jenkins-hbase4.apache.org%2C43777%2C1689704067457.1689704070502 2023-07-18 18:14:30,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK], DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK]] 2023-07-18 18:14:30,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:30,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:30,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:30,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:30,720 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:30,728 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 18:14:30,771 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 18:14:30,790 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:30,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:30,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:30,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:30,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:30,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10316313920, jitterRate=-0.039218395948410034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:30,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:14:30,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 18:14:30,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 18:14:30,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 18:14:30,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 18:14:30,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 11 msec 2023-07-18 18:14:30,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 55 msec 2023-07-18 18:14:30,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 18:14:30,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 18:14:31,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 18:14:31,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 18:14:31,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 18:14:31,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 18:14:31,035 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:31,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 18:14:31,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 18:14:31,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 18:14:31,062 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:31,062 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:31,062 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:31,062 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:31,062 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:31,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43777,1689704067457, sessionid=0x10179a470da0000, setting cluster-up flag (Was=false) 2023-07-18 18:14:31,085 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:31,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 18:14:31,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:31,103 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:31,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 18:14:31,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:31,114 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.hbase-snapshot/.tmp 2023-07-18 18:14:31,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=RSGroupAdminService 2023-07-18 18:14:31,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] rsgroup.RSGroupInfoManagerImpl(537): Refreshing in Offline mode. 2023-07-18 18:14:31,210 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:31,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint loaded, priority=536870911. 2023-07-18 18:14:31,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver loaded, priority=536870912. 2023-07-18 18:14:31,213 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(951): ClusterId : 911f5b62-2018-4aaf-97ae-f83d1d743503 2023-07-18 18:14:31,214 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(951): ClusterId : 911f5b62-2018-4aaf-97ae-f83d1d743503 2023-07-18 18:14:31,213 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(951): ClusterId : 911f5b62-2018-4aaf-97ae-f83d1d743503 2023-07-18 18:14:31,220 DEBUG [RS:1;jenkins-hbase4:46845] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:14:31,220 DEBUG [RS:0;jenkins-hbase4:43237] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:14:31,220 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:14:31,228 DEBUG [RS:0;jenkins-hbase4:43237] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:14:31,228 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:14:31,228 DEBUG [RS:1;jenkins-hbase4:46845] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:14:31,228 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:14:31,228 DEBUG [RS:0;jenkins-hbase4:43237] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:14:31,228 DEBUG [RS:1;jenkins-hbase4:46845] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:14:31,232 DEBUG [RS:0;jenkins-hbase4:43237] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:14:31,232 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:14:31,235 DEBUG [RS:0;jenkins-hbase4:43237] zookeeper.ReadOnlyZKClient(139): Connect 0x1bb27f55 to 127.0.0.1:53006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:31,236 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ReadOnlyZKClient(139): Connect 0x15b01a3a to 127.0.0.1:53006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:31,232 DEBUG [RS:1;jenkins-hbase4:46845] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:14:31,243 DEBUG [RS:1;jenkins-hbase4:46845] zookeeper.ReadOnlyZKClient(139): Connect 0x6a10e6bf to 127.0.0.1:53006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:31,253 DEBUG [RS:0;jenkins-hbase4:43237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d749999, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:31,255 DEBUG [RS:0;jenkins-hbase4:43237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@497c272a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:14:31,257 DEBUG [RS:1;jenkins-hbase4:46845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40debdf1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:31,257 DEBUG [RS:1;jenkins-hbase4:46845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@562db6a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:14:31,260 DEBUG [RS:2;jenkins-hbase4:36811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ac04b98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:31,260 DEBUG [RS:2;jenkins-hbase4:36811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b4e590c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:14:31,362 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36811 2023-07-18 18:14:31,378 DEBUG [RS:0;jenkins-hbase4:43237] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43237 2023-07-18 18:14:31,390 INFO [RS:2;jenkins-hbase4:36811] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:14:31,390 INFO [RS:0;jenkins-hbase4:43237] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:14:31,393 INFO [RS:0;jenkins-hbase4:43237] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:14:31,393 INFO [RS:2;jenkins-hbase4:36811] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:14:31,393 DEBUG [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:14:31,394 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:14:31,394 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46845 2023-07-18 18:14:31,394 INFO [RS:1;jenkins-hbase4:46845] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:14:31,394 INFO [RS:1;jenkins-hbase4:46845] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:14:31,394 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:14:31,398 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43777,1689704067457 with isa=jenkins-hbase4.apache.org/172.31.14.131:36811, startcode=1689704069850 2023-07-18 18:14:31,398 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43777,1689704067457 with isa=jenkins-hbase4.apache.org/172.31.14.131:43237, startcode=1689704069417 2023-07-18 18:14:31,398 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43777,1689704067457 with isa=jenkins-hbase4.apache.org/172.31.14.131:46845, startcode=1689704069644 2023-07-18 18:14:31,421 DEBUG [RS:2;jenkins-hbase4:36811] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:14:31,421 DEBUG [RS:0;jenkins-hbase4:43237] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:14:31,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 18:14:31,421 DEBUG [RS:1;jenkins-hbase4:46845] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:14:31,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 18:14:31,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 18:14:31,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 18:14:31,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 18:14:31,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:14:31,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:14:31,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:14:31,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:14:31,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 18:14:31,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:31,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689704101479 2023-07-18 18:14:31,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 18:14:31,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 18:14:31,487 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33567, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:14:31,487 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56425, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:14:31,487 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60991, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:14:31,498 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:31,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 18:14:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 18:14:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 18:14:31,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 18:14:31,503 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:14:31,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,504 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 18:14:31,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 18:14:31,507 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:31,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 18:14:31,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 18:14:31,509 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:31,511 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:31,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 18:14:31,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 18:14:31,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704071516,5,FailOnTimeoutGroup] 2023-07-18 18:14:31,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704071517,5,FailOnTimeoutGroup] 2023-07-18 18:14:31,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 18:14:31,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,535 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 18:14:31,535 DEBUG [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 18:14:31,536 WARN [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 18:14:31,535 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 18:14:31,536 WARN [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 18:14:31,536 WARN [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 18:14:31,606 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:31,607 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:31,608 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c 2023-07-18 18:14:31,638 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43777,1689704067457 with isa=jenkins-hbase4.apache.org/172.31.14.131:43237, startcode=1689704069417 2023-07-18 18:14:31,638 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43777,1689704067457 with isa=jenkins-hbase4.apache.org/172.31.14.131:46845, startcode=1689704069644 2023-07-18 18:14:31,638 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43777,1689704067457 with isa=jenkins-hbase4.apache.org/172.31.14.131:36811, startcode=1689704069850 2023-07-18 18:14:31,648 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43777] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:31,650 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:31,651 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 1 2023-07-18 18:14:31,652 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:31,657 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:14:31,658 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43777] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:31,658 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:31,658 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 2 2023-07-18 18:14:31,659 DEBUG [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c 2023-07-18 18:14:31,659 DEBUG [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46377 2023-07-18 18:14:31,659 DEBUG [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=44795 2023-07-18 18:14:31,659 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43777] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:31,659 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:31,660 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 3 2023-07-18 18:14:31,662 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c 2023-07-18 18:14:31,663 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c 2023-07-18 18:14:31,663 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46377 2023-07-18 18:14:31,663 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info 2023-07-18 18:14:31,663 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=44795 2023-07-18 18:14:31,663 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46377 2023-07-18 18:14:31,663 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=44795 2023-07-18 18:14:31,664 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:14:31,665 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:31,665 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:14:31,667 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:31,669 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:31,669 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:14:31,670 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:31,671 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:14:31,673 DEBUG [RS:1;jenkins-hbase4:46845] zookeeper.ZKUtil(162): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:31,673 WARN [RS:1;jenkins-hbase4:46845] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:31,673 INFO [RS:1;jenkins-hbase4:46845] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:31,673 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table 2023-07-18 18:14:31,673 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:31,674 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ZKUtil(162): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:31,674 DEBUG [RS:0;jenkins-hbase4:43237] zookeeper.ZKUtil(162): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:31,674 WARN [RS:0;jenkins-hbase4:43237] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:31,674 WARN [RS:2;jenkins-hbase4:36811] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:31,674 INFO [RS:0;jenkins-hbase4:43237] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:31,675 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:14:31,675 DEBUG [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:31,674 INFO [RS:2;jenkins-hbase4:36811] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:31,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:31,675 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46845,1689704069644] 2023-07-18 18:14:31,681 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43237,1689704069417] 2023-07-18 18:14:31,681 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36811,1689704069850] 2023-07-18 18:14:31,680 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:31,682 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740 2023-07-18 18:14:31,682 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740 2023-07-18 18:14:31,695 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:14:31,697 DEBUG [RS:1;jenkins-hbase4:46845] zookeeper.ZKUtil(162): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:31,698 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ZKUtil(162): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:31,698 DEBUG [RS:1;jenkins-hbase4:46845] zookeeper.ZKUtil(162): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:31,698 DEBUG [RS:0;jenkins-hbase4:43237] zookeeper.ZKUtil(162): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:31,699 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ZKUtil(162): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:31,699 DEBUG [RS:1;jenkins-hbase4:46845] zookeeper.ZKUtil(162): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:31,699 DEBUG [RS:0;jenkins-hbase4:43237] zookeeper.ZKUtil(162): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:31,700 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ZKUtil(162): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:31,700 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:14:31,700 DEBUG [RS:0;jenkins-hbase4:43237] zookeeper.ZKUtil(162): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:31,704 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:31,706 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9612006720, jitterRate=-0.10481211543083191}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:14:31,706 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:14:31,707 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:14:31,707 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:14:31,707 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:14:31,707 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:14:31,707 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:14:31,711 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:14:31,711 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:14:31,714 DEBUG [RS:2;jenkins-hbase4:36811] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:14:31,714 DEBUG [RS:0;jenkins-hbase4:43237] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:14:31,714 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:14:31,723 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:14:31,723 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 18:14:31,729 INFO [RS:0;jenkins-hbase4:43237] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:14:31,729 INFO [RS:1;jenkins-hbase4:46845] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:14:31,729 INFO [RS:2;jenkins-hbase4:36811] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:14:31,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 18:14:31,747 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 18:14:31,750 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 18:14:31,753 INFO [RS:2;jenkins-hbase4:36811] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:14:31,753 INFO [RS:0;jenkins-hbase4:43237] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:14:31,753 INFO [RS:1;jenkins-hbase4:46845] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:14:31,758 INFO [RS:2;jenkins-hbase4:36811] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:14:31,758 INFO [RS:1;jenkins-hbase4:46845] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:14:31,759 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,758 INFO [RS:0;jenkins-hbase4:43237] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:14:31,759 INFO [RS:1;jenkins-hbase4:46845] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,760 INFO [RS:0;jenkins-hbase4:43237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,760 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:14:31,761 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:14:31,761 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:14:31,770 INFO [RS:1;jenkins-hbase4:46845] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,770 INFO [RS:0;jenkins-hbase4:43237] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,770 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,770 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,770 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,770 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,771 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,771 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,771 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,771 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,771 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,771 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,771 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:31,771 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,771 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:31,772 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:1;jenkins-hbase4:46845] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:0;jenkins-hbase4:43237] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,772 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:31,772 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,773 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,773 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,773 DEBUG [RS:2;jenkins-hbase4:36811] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:31,775 INFO [RS:1;jenkins-hbase4:46845] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,775 INFO [RS:1;jenkins-hbase4:46845] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,775 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,775 INFO [RS:1;jenkins-hbase4:46845] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,775 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,775 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,776 INFO [RS:0;jenkins-hbase4:43237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,776 INFO [RS:0;jenkins-hbase4:43237] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,776 INFO [RS:0;jenkins-hbase4:43237] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,793 INFO [RS:2;jenkins-hbase4:36811] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:14:31,793 INFO [RS:1;jenkins-hbase4:46845] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:14:31,793 INFO [RS:0;jenkins-hbase4:43237] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:14:31,797 INFO [RS:1;jenkins-hbase4:46845] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46845,1689704069644-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,797 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36811,1689704069850-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,797 INFO [RS:0;jenkins-hbase4:43237] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43237,1689704069417-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:31,826 INFO [RS:0;jenkins-hbase4:43237] regionserver.Replication(203): jenkins-hbase4.apache.org,43237,1689704069417 started 2023-07-18 18:14:31,827 INFO [RS:2;jenkins-hbase4:36811] regionserver.Replication(203): jenkins-hbase4.apache.org,36811,1689704069850 started 2023-07-18 18:14:31,827 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43237,1689704069417, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43237, sessionid=0x10179a470da0001 2023-07-18 18:14:31,827 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36811,1689704069850, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36811, sessionid=0x10179a470da0003 2023-07-18 18:14:31,827 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:14:31,827 DEBUG [RS:0;jenkins-hbase4:43237] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:14:31,827 DEBUG [RS:2;jenkins-hbase4:36811] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:31,827 DEBUG [RS:0;jenkins-hbase4:43237] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:31,828 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36811,1689704069850' 2023-07-18 18:14:31,828 DEBUG [RS:0;jenkins-hbase4:43237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43237,1689704069417' 2023-07-18 18:14:31,829 DEBUG [RS:0;jenkins-hbase4:43237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:14:31,829 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:14:31,829 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:14:31,829 DEBUG [RS:0;jenkins-hbase4:43237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:14:31,830 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:14:31,830 DEBUG [RS:0;jenkins-hbase4:43237] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:14:31,830 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:14:31,830 DEBUG [RS:0;jenkins-hbase4:43237] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:14:31,830 DEBUG [RS:2;jenkins-hbase4:36811] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:31,831 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36811,1689704069850' 2023-07-18 18:14:31,831 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:14:31,830 DEBUG [RS:0;jenkins-hbase4:43237] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:31,831 DEBUG [RS:0;jenkins-hbase4:43237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43237,1689704069417' 2023-07-18 18:14:31,831 DEBUG [RS:0;jenkins-hbase4:43237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:14:31,832 DEBUG [RS:2;jenkins-hbase4:36811] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:14:31,832 INFO [RS:1;jenkins-hbase4:46845] regionserver.Replication(203): jenkins-hbase4.apache.org,46845,1689704069644 started 2023-07-18 18:14:31,832 DEBUG [RS:0;jenkins-hbase4:43237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:14:31,832 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46845,1689704069644, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46845, sessionid=0x10179a470da0002 2023-07-18 18:14:31,832 DEBUG [RS:1;jenkins-hbase4:46845] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:14:31,832 DEBUG [RS:2;jenkins-hbase4:36811] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:14:31,832 DEBUG [RS:1;jenkins-hbase4:46845] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:31,832 DEBUG [RS:1;jenkins-hbase4:46845] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46845,1689704069644' 2023-07-18 18:14:31,832 DEBUG [RS:1;jenkins-hbase4:46845] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:14:31,832 DEBUG [RS:0;jenkins-hbase4:43237] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:14:31,832 INFO [RS:2;jenkins-hbase4:36811] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:14:31,833 INFO [RS:0;jenkins-hbase4:43237] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:14:31,833 INFO [RS:2;jenkins-hbase4:36811] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:14:31,833 INFO [RS:0;jenkins-hbase4:43237] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:14:31,835 DEBUG [RS:1;jenkins-hbase4:46845] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:14:31,836 DEBUG [RS:1;jenkins-hbase4:46845] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:14:31,836 DEBUG [RS:1;jenkins-hbase4:46845] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:14:31,836 DEBUG [RS:1;jenkins-hbase4:46845] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:31,836 DEBUG [RS:1;jenkins-hbase4:46845] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46845,1689704069644' 2023-07-18 18:14:31,836 DEBUG [RS:1;jenkins-hbase4:46845] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:14:31,836 DEBUG [RS:1;jenkins-hbase4:46845] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:14:31,837 DEBUG [RS:1;jenkins-hbase4:46845] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:14:31,837 INFO [RS:1;jenkins-hbase4:46845] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:14:31,837 INFO [RS:1;jenkins-hbase4:46845] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:14:31,902 DEBUG [jenkins-hbase4:43777] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 18:14:31,916 DEBUG [jenkins-hbase4:43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:31,917 DEBUG [jenkins-hbase4:43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:31,918 DEBUG [jenkins-hbase4:43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:31,918 DEBUG [jenkins-hbase4:43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:31,918 DEBUG [jenkins-hbase4:43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:31,921 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36811,1689704069850, state=OPENING 2023-07-18 18:14:31,929 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 18:14:31,930 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:31,931 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:31,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:31,948 INFO [RS:0;jenkins-hbase4:43237] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43237%2C1689704069417, suffix=, logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,43237,1689704069417, archiveDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs, maxLogs=32 2023-07-18 18:14:31,948 INFO [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36811%2C1689704069850, suffix=, logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,36811,1689704069850, archiveDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs, maxLogs=32 2023-07-18 18:14:31,948 INFO [RS:1;jenkins-hbase4:46845] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46845%2C1689704069644, suffix=, logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46845,1689704069644, archiveDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs, maxLogs=32 2023-07-18 18:14:31,997 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK] 2023-07-18 18:14:31,997 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK] 2023-07-18 18:14:31,997 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK] 2023-07-18 18:14:31,999 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK] 2023-07-18 18:14:31,999 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK] 2023-07-18 18:14:31,999 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK] 2023-07-18 18:14:32,005 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK] 2023-07-18 18:14:32,007 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK] 2023-07-18 18:14:32,011 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK] 2023-07-18 18:14:32,017 INFO [RS:0;jenkins-hbase4:43237] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,43237,1689704069417/jenkins-hbase4.apache.org%2C43237%2C1689704069417.1689704071953 2023-07-18 18:14:32,018 INFO [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,36811,1689704069850/jenkins-hbase4.apache.org%2C36811%2C1689704069850.1689704071953 2023-07-18 18:14:32,018 INFO [RS:1;jenkins-hbase4:46845] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46845,1689704069644/jenkins-hbase4.apache.org%2C46845%2C1689704069644.1689704071953 2023-07-18 18:14:32,018 DEBUG [RS:0;jenkins-hbase4:43237] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK], DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK]] 2023-07-18 18:14:32,018 DEBUG [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK], DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK]] 2023-07-18 18:14:32,019 DEBUG [RS:1;jenkins-hbase4:46845] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK], DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK]] 2023-07-18 18:14:32,080 WARN [ReadOnlyZKClient-127.0.0.1:53006@0x0f728771] client.ZKConnectionRegistry(168): Meta region is in state OPENING 2023-07-18 18:14:32,107 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,43777,1689704067457] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:32,112 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:32,113 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36811] ipc.CallRunner(144): callId: 0 service: ClientService methodName: Get size: 88 connection: 172.31.14.131:60668 deadline: 1689704132113, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:32,122 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:32,126 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:32,131 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:32,144 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 18:14:32,144 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:32,150 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36811%2C1689704069850.meta, suffix=.meta, logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,36811,1689704069850, archiveDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs, maxLogs=32 2023-07-18 18:14:32,168 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK] 2023-07-18 18:14:32,169 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK] 2023-07-18 18:14:32,170 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK] 2023-07-18 18:14:32,175 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,36811,1689704069850/jenkins-hbase4.apache.org%2C36811%2C1689704069850.meta.1689704072151.meta 2023-07-18 18:14:32,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK], DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK]] 2023-07-18 18:14:32,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:32,178 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:14:32,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 18:14:32,182 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 18:14:32,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 18:14:32,187 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:32,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 18:14:32,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 18:14:32,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:14:32,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info 2023-07-18 18:14:32,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info 2023-07-18 18:14:32,192 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:14:32,193 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:32,193 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:14:32,195 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:32,195 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:32,195 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:14:32,196 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:32,196 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:14:32,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table 2023-07-18 18:14:32,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table 2023-07-18 18:14:32,198 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:14:32,199 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:32,200 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740 2023-07-18 18:14:32,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740 2023-07-18 18:14:32,206 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:14:32,209 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:14:32,212 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10022093600, jitterRate=-0.06661979854106903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:14:32,212 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:14:32,222 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689704072119 2023-07-18 18:14:32,247 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 18:14:32,249 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 18:14:32,250 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36811,1689704069850, state=OPEN 2023-07-18 18:14:32,256 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:14:32,256 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:32,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 18:14:32,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36811,1689704069850 in 322 msec 2023-07-18 18:14:32,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 18:14:32,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 531 msec 2023-07-18 18:14:32,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0520 sec 2023-07-18 18:14:32,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689704072276, completionTime=-1 2023-07-18 18:14:32,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 18:14:32,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 18:14:32,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 18:14:32,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689704132333 2023-07-18 18:14:32,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689704192333 2023-07-18 18:14:32,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 56 msec 2023-07-18 18:14:32,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43777,1689704067457-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:32,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43777,1689704067457-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:32,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43777,1689704067457-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:32,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43777, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:32,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:32,366 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 18:14:32,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 18:14:32,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:32,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 18:14:32,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:32,392 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:32,407 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,410 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7 empty. 2023-07-18 18:14:32,410 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,411 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 18:14:32,447 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:32,449 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d6adb109ae18a073027d49e3dc8869d7, NAME => 'hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:32,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:32,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d6adb109ae18a073027d49e3dc8869d7, disabling compactions & flushes 2023-07-18 18:14:32,482 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:32,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:32,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. after waiting 0 ms 2023-07-18 18:14:32,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:32,482 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:32,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d6adb109ae18a073027d49e3dc8869d7: 2023-07-18 18:14:32,487 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:32,506 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704072491"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704072491"}]},"ts":"1689704072491"} 2023-07-18 18:14:32,540 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:14:32,542 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:32,548 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704072542"}]},"ts":"1689704072542"} 2023-07-18 18:14:32,553 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 18:14:32,557 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:32,557 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:32,557 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:32,557 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:32,557 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:32,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d6adb109ae18a073027d49e3dc8869d7, ASSIGN}] 2023-07-18 18:14:32,563 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d6adb109ae18a073027d49e3dc8869d7, ASSIGN 2023-07-18 18:14:32,565 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d6adb109ae18a073027d49e3dc8869d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:32,631 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,43777,1689704067457] master.HMaster(2148): Client=null/null create 'hbase:rsgroup', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|', METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'm', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:32,635 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,43777,1689704067457] procedure2.ProcedureExecutor(1029): Stored pid=6, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:rsgroup 2023-07-18 18:14:32,637 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:32,641 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:32,646 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:32,647 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0 empty. 2023-07-18 18:14:32,648 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:32,648 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:rsgroup regions 2023-07-18 18:14:32,677 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/hbase/rsgroup/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:32,679 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(7675): creating {ENCODED => 99483aa0b47f744a4342bbff898effe0, NAME => 'hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:rsgroup', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|', METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'm', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:32,710 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(866): Instantiated hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:32,710 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1604): Closing 99483aa0b47f744a4342bbff898effe0, disabling compactions & flushes 2023-07-18 18:14:32,710 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1626): Closing region hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:32,710 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:32,710 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. after waiting 0 ms 2023-07-18 18:14:32,710 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:32,711 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1838): Closed hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:32,711 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1558): Region close journal for 99483aa0b47f744a4342bbff898effe0: 2023-07-18 18:14:32,715 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:32,716 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:32,717 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704072716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704072716"}]},"ts":"1689704072716"} 2023-07-18 18:14:32,718 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d6adb109ae18a073027d49e3dc8869d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:32,718 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704072718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704072718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704072718"}]},"ts":"1689704072718"} 2023-07-18 18:14:32,725 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:14:32,729 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:32,729 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:rsgroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704072729"}]},"ts":"1689704072729"} 2023-07-18 18:14:32,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=7, ppid=5, state=RUNNABLE; OpenRegionProcedure d6adb109ae18a073027d49e3dc8869d7, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:32,732 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:rsgroup, state=ENABLING in hbase:meta 2023-07-18 18:14:32,736 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:32,737 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:32,737 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:32,737 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:32,737 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:32,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=8, ppid=6, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:rsgroup, region=99483aa0b47f744a4342bbff898effe0, ASSIGN}] 2023-07-18 18:14:32,740 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=8, ppid=6, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:rsgroup, region=99483aa0b47f744a4342bbff898effe0, ASSIGN 2023-07-18 18:14:32,742 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=8, ppid=6, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:rsgroup, region=99483aa0b47f744a4342bbff898effe0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:32,883 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:32,883 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:32,887 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:32,892 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:32,893 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=8 updating hbase:meta row=99483aa0b47f744a4342bbff898effe0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:32,894 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704072893"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704072893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704072893"}]},"ts":"1689704072893"} 2023-07-18 18:14:32,894 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:32,894 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6adb109ae18a073027d49e3dc8869d7, NAME => 'hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:32,895 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:32,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=9, ppid=8, state=RUNNABLE; OpenRegionProcedure 99483aa0b47f744a4342bbff898effe0, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:32,899 INFO [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,902 DEBUG [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/info 2023-07-18 18:14:32,902 DEBUG [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/info 2023-07-18 18:14:32,903 INFO [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6adb109ae18a073027d49e3dc8869d7 columnFamilyName info 2023-07-18 18:14:32,904 INFO [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] regionserver.HStore(310): Store=d6adb109ae18a073027d49e3dc8869d7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:32,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,912 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:32,916 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:32,917 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d6adb109ae18a073027d49e3dc8869d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10652951040, jitterRate=-0.007866621017456055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:32,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d6adb109ae18a073027d49e3dc8869d7: 2023-07-18 18:14:32,919 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7., pid=7, masterSystemTime=1689704072883 2023-07-18 18:14:32,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:32,923 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:32,925 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d6adb109ae18a073027d49e3dc8869d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:32,925 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704072924"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704072924"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704072924"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704072924"}]},"ts":"1689704072924"} 2023-07-18 18:14:32,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=7, resume processing ppid=5 2023-07-18 18:14:32,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, ppid=5, state=SUCCESS; OpenRegionProcedure d6adb109ae18a073027d49e3dc8869d7, server=jenkins-hbase4.apache.org,43237,1689704069417 in 200 msec 2023-07-18 18:14:32,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 18:14:32,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d6adb109ae18a073027d49e3dc8869d7, ASSIGN in 375 msec 2023-07-18 18:14:32,940 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:32,940 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704072940"}]},"ts":"1689704072940"} 2023-07-18 18:14:32,942 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 18:14:32,946 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:32,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 568 msec 2023-07-18 18:14:32,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 18:14:32,992 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:14:32,992 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:33,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:33,020 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:33,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 18:14:33,069 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:14:33,071 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:33,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99483aa0b47f744a4342bbff898effe0, NAME => 'hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:33,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:14:33,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. service=MultiRowMutationService 2023-07-18 18:14:33,073 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:rsgroup successfully. 2023-07-18 18:14:33,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table rsgroup 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:33,073 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:33,074 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:33,074 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:33,076 INFO [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family m of region 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:33,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 51 msec 2023-07-18 18:14:33,085 DEBUG [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m 2023-07-18 18:14:33,085 DEBUG [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m 2023-07-18 18:14:33,085 INFO [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99483aa0b47f744a4342bbff898effe0 columnFamilyName m 2023-07-18 18:14:33,086 INFO [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] regionserver.HStore(310): Store=99483aa0b47f744a4342bbff898effe0/m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:33,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=11, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 18:14:33,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:33,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:33,093 DEBUG [PEWorker-1] procedure.MasterProcedureScheduler(526): NAMESPACE 'hbase', shared lock count=1 2023-07-18 18:14:33,093 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1400): LOCK_EVENT_WAIT pid=11, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 18:14:33,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:33,099 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:33,100 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 99483aa0b47f744a4342bbff898effe0; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@ac1c9cb, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:33,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 99483aa0b47f744a4342bbff898effe0: 2023-07-18 18:14:33,101 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0., pid=9, masterSystemTime=1689704073064 2023-07-18 18:14:33,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:33,105 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:33,105 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=8 updating hbase:meta row=99483aa0b47f744a4342bbff898effe0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,106 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704073105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704073105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704073105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704073105"}]},"ts":"1689704073105"} 2023-07-18 18:14:33,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=9, resume processing ppid=8 2023-07-18 18:14:33,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, ppid=8, state=SUCCESS; OpenRegionProcedure 99483aa0b47f744a4342bbff898effe0, server=jenkins-hbase4.apache.org,43237,1689704069417 in 210 msec 2023-07-18 18:14:33,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=8, resume processing ppid=6 2023-07-18 18:14:33,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, ppid=6, state=SUCCESS; TransitRegionStateProcedure table=hbase:rsgroup, region=99483aa0b47f744a4342bbff898effe0, ASSIGN in 375 msec 2023-07-18 18:14:33,129 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:14:33,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 48 msec 2023-07-18 18:14:33,139 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:33,139 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:rsgroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704073139"}]},"ts":"1689704073139"} 2023-07-18 18:14:33,141 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:rsgroup, state=ENABLED in hbase:meta 2023-07-18 18:14:33,151 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:33,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=6, state=SUCCESS; CreateTableProcedure table=hbase:rsgroup in 520 msec 2023-07-18 18:14:33,156 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 18:14:33,161 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 18:14:33,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.093sec 2023-07-18 18:14:33,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 18:14:33,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 18:14:33,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 18:14:33,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43777,1689704067457-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 18:14:33,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43777,1689704067457-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 18:14:33,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 18:14:33,231 DEBUG [Listener at localhost/35951] zookeeper.ReadOnlyZKClient(139): Connect 0x3e4d79c0 to 127.0.0.1:53006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:33,237 DEBUG [Listener at localhost/35951] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@326b7986, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:33,242 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker(840): RSGroup table=hbase:rsgroup is online, refreshing cached information 2023-07-18 18:14:33,242 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl(534): Refreshing in Online mode. 2023-07-18 18:14:33,253 DEBUG [hconnection-0x497c82a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:33,270 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:33,284 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:33,286 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:33,298 DEBUG [Listener at localhost/35951] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 18:14:33,303 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 18:14:33,319 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-18 18:14:33,319 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:33,320 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:33,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(492): Client=jenkins//172.31.14.131 set balanceSwitch=false 2023-07-18 18:14:33,324 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 2 2023-07-18 18:14:33,327 DEBUG [Listener at localhost/35951] zookeeper.ReadOnlyZKClient(139): Connect 0x13aa6d9f to 127.0.0.1:53006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:33,332 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker(823): GroupBasedLoadBalancer is now online 2023-07-18 18:14:33,336 DEBUG [Listener at localhost/35951] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30296f6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:33,336 INFO [Listener at localhost/35951] zookeeper.RecoverableZooKeeper(93): Process identifier=VerifyingRSGroupAdminClient connecting to ZooKeeper ensemble=127.0.0.1:53006 2023-07-18 18:14:33,340 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): VerifyingRSGroupAdminClient0x0, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:33,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): VerifyingRSGroupAdminClient-0x10179a470da000a connected 2023-07-18 18:14:33,377 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testTableMoveTruncateAndDrop Thread=421, OpenFileDescriptor=677, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=173, AvailableMemoryMB=3973 2023-07-18 18:14:33,380 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testTableMoveTruncateAndDrop 2023-07-18 18:14:33,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:33,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:33,473 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 1 2023-07-18 18:14:33,486 INFO [Listener at localhost/35951] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:33,486 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:33,487 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:33,487 INFO [Listener at localhost/35951] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:33,487 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:33,487 INFO [Listener at localhost/35951] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:33,487 INFO [Listener at localhost/35951] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:33,491 INFO [Listener at localhost/35951] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46365 2023-07-18 18:14:33,492 INFO [Listener at localhost/35951] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:14:33,506 DEBUG [Listener at localhost/35951] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:14:33,508 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:33,513 INFO [Listener at localhost/35951] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:33,518 INFO [Listener at localhost/35951] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46365 connecting to ZooKeeper ensemble=127.0.0.1:53006 2023-07-18 18:14:33,526 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:463650x0, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:33,527 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(162): regionserver:463650x0, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:14:33,529 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(162): regionserver:463650x0, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/running 2023-07-18 18:14:33,530 DEBUG [Listener at localhost/35951] zookeeper.ZKUtil(164): regionserver:463650x0, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:33,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46365-0x10179a470da000b connected 2023-07-18 18:14:33,537 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46365 2023-07-18 18:14:33,538 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46365 2023-07-18 18:14:33,541 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46365 2023-07-18 18:14:33,546 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46365 2023-07-18 18:14:33,546 DEBUG [Listener at localhost/35951] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46365 2023-07-18 18:14:33,549 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:33,549 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:33,549 INFO [Listener at localhost/35951] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:33,550 INFO [Listener at localhost/35951] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:14:33,550 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:33,550 INFO [Listener at localhost/35951] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:33,550 INFO [Listener at localhost/35951] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:33,551 INFO [Listener at localhost/35951] http.HttpServer(1146): Jetty bound to port 45859 2023-07-18 18:14:33,551 INFO [Listener at localhost/35951] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:33,555 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:33,555 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@6dd20c46{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:33,556 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:33,556 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@726126ec{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:33,686 INFO [Listener at localhost/35951] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:33,687 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:33,687 INFO [Listener at localhost/35951] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:33,688 INFO [Listener at localhost/35951] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:33,689 INFO [Listener at localhost/35951] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:33,690 INFO [Listener at localhost/35951] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@519b7a7c{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/java.io.tmpdir/jetty-0_0_0_0-45859-hbase-server-2_4_18-SNAPSHOT_jar-_-any-4849002015106062537/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:33,692 INFO [Listener at localhost/35951] server.AbstractConnector(333): Started ServerConnector@1c038137{HTTP/1.1, (http/1.1)}{0.0.0.0:45859} 2023-07-18 18:14:33,692 INFO [Listener at localhost/35951] server.Server(415): Started @11969ms 2023-07-18 18:14:33,695 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(951): ClusterId : 911f5b62-2018-4aaf-97ae-f83d1d743503 2023-07-18 18:14:33,696 DEBUG [RS:3;jenkins-hbase4:46365] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:14:33,705 DEBUG [RS:3;jenkins-hbase4:46365] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:14:33,705 DEBUG [RS:3;jenkins-hbase4:46365] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:14:33,707 DEBUG [RS:3;jenkins-hbase4:46365] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:14:33,710 DEBUG [RS:3;jenkins-hbase4:46365] zookeeper.ReadOnlyZKClient(139): Connect 0x5fc58c1f to 127.0.0.1:53006 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:33,721 DEBUG [RS:3;jenkins-hbase4:46365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51026997, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:33,721 DEBUG [RS:3;jenkins-hbase4:46365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@553de76f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:14:33,735 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:3;jenkins-hbase4:46365 2023-07-18 18:14:33,735 INFO [RS:3;jenkins-hbase4:46365] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:14:33,735 INFO [RS:3;jenkins-hbase4:46365] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:14:33,735 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:14:33,736 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43777,1689704067457 with isa=jenkins-hbase4.apache.org/172.31.14.131:46365, startcode=1689704073486 2023-07-18 18:14:33,736 DEBUG [RS:3;jenkins-hbase4:46365] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:14:33,740 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39103, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:14:33,741 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43777] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,741 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:33,741 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c 2023-07-18 18:14:33,741 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46377 2023-07-18 18:14:33,741 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=44795 2023-07-18 18:14:33,746 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:33,746 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:33,746 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:33,746 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:33,748 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46365,1689704073486] 2023-07-18 18:14:33,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,749 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:33,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:33,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:33,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:33,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,750 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 2 2023-07-18 18:14:33,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:33,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,751 DEBUG [RS:3;jenkins-hbase4:46365] zookeeper.ZKUtil(162): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,751 WARN [RS:3;jenkins-hbase4:46365] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:33,751 INFO [RS:3;jenkins-hbase4:46365] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:33,752 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:33,765 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,43777,1689704067457] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 4 2023-07-18 18:14:33,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:33,769 DEBUG [RS:3;jenkins-hbase4:46365] zookeeper.ZKUtil(162): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,770 DEBUG [RS:3;jenkins-hbase4:46365] zookeeper.ZKUtil(162): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:33,771 DEBUG [RS:3;jenkins-hbase4:46365] zookeeper.ZKUtil(162): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,771 DEBUG [RS:3;jenkins-hbase4:46365] zookeeper.ZKUtil(162): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:33,772 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:14:33,773 INFO [RS:3;jenkins-hbase4:46365] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:14:33,778 INFO [RS:3;jenkins-hbase4:46365] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:14:33,778 INFO [RS:3;jenkins-hbase4:46365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:14:33,778 INFO [RS:3;jenkins-hbase4:46365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:33,778 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:14:33,781 INFO [RS:3;jenkins-hbase4:46365] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:33,781 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,781 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,781 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,781 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,782 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,782 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:33,782 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,782 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,782 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,782 DEBUG [RS:3;jenkins-hbase4:46365] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:33,787 INFO [RS:3;jenkins-hbase4:46365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:33,787 INFO [RS:3;jenkins-hbase4:46365] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:33,787 INFO [RS:3;jenkins-hbase4:46365] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:33,802 INFO [RS:3;jenkins-hbase4:46365] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:14:33,803 INFO [RS:3;jenkins-hbase4:46365] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46365,1689704073486-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:33,820 INFO [RS:3;jenkins-hbase4:46365] regionserver.Replication(203): jenkins-hbase4.apache.org,46365,1689704073486 started 2023-07-18 18:14:33,820 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46365,1689704073486, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46365, sessionid=0x10179a470da000b 2023-07-18 18:14:33,820 DEBUG [RS:3;jenkins-hbase4:46365] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:14:33,820 DEBUG [RS:3;jenkins-hbase4:46365] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,820 DEBUG [RS:3;jenkins-hbase4:46365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46365,1689704073486' 2023-07-18 18:14:33,820 DEBUG [RS:3;jenkins-hbase4:46365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:14:33,821 DEBUG [RS:3;jenkins-hbase4:46365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:14:33,821 DEBUG [RS:3;jenkins-hbase4:46365] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:14:33,821 DEBUG [RS:3;jenkins-hbase4:46365] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:14:33,821 DEBUG [RS:3;jenkins-hbase4:46365] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:33,821 DEBUG [RS:3;jenkins-hbase4:46365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46365,1689704073486' 2023-07-18 18:14:33,821 DEBUG [RS:3;jenkins-hbase4:46365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:14:33,822 DEBUG [RS:3;jenkins-hbase4:46365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:14:33,822 DEBUG [RS:3;jenkins-hbase4:46365] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:14:33,822 INFO [RS:3;jenkins-hbase4:46365] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:14:33,822 INFO [RS:3;jenkins-hbase4:46365] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:14:33,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:33,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:33,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:33,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:33,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:33,840 DEBUG [hconnection-0x120ad869-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:33,844 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:33,853 DEBUG [hconnection-0x120ad869-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:33,855 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:33,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:33,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:33,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:33,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:33,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 20 service: MasterService methodName: ExecMasterService size: 118 connection: 172.31.14.131:58898 deadline: 1689705273868, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:33,871 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:33,874 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:33,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:33,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:33,877 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:33,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:33,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:33,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:33,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:33,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:33,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:33,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:33,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:33,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:33,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:33,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:33,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:33,929 INFO [RS:3;jenkins-hbase4:46365] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46365%2C1689704073486, suffix=, logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46365,1689704073486, archiveDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs, maxLogs=32 2023-07-18 18:14:33,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811] to rsgroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:33,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:33,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:33,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:33,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:33,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(238): Moving server region 1588230740, which do not belong to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:33,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, REOPEN/MOVE 2023-07-18 18:14:33,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(238): Moving server region 99483aa0b47f744a4342bbff898effe0, which do not belong to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:33,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:33,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:33,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:33,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:33,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:33,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=hbase:rsgroup, region=99483aa0b47f744a4342bbff898effe0, REOPEN/MOVE 2023-07-18 18:14:33,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(238): Moving server region d6adb109ae18a073027d49e3dc8869d7, which do not belong to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:33,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:33,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:33,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:33,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:33,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:33,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=hbase:namespace, region=d6adb109ae18a073027d49e3dc8869d7, REOPEN/MOVE 2023-07-18 18:14:33,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 3 region(s) to group default, current retry=0 2023-07-18 18:14:33,964 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, REOPEN/MOVE 2023-07-18 18:14:33,964 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=hbase:namespace, region=d6adb109ae18a073027d49e3dc8869d7, REOPEN/MOVE 2023-07-18 18:14:33,964 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=hbase:rsgroup, region=99483aa0b47f744a4342bbff898effe0, REOPEN/MOVE 2023-07-18 18:14:33,968 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36811,1689704069850, state=CLOSING 2023-07-18 18:14:33,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=99483aa0b47f744a4342bbff898effe0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,968 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d6adb109ae18a073027d49e3dc8869d7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,969 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704073968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704073968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704073968"}]},"ts":"1689704073968"} 2023-07-18 18:14:33,969 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704073968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704073968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704073968"}]},"ts":"1689704073968"} 2023-07-18 18:14:33,971 DEBUG [RS-EventLoopGroup-7-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK] 2023-07-18 18:14:33,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE; CloseRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:33,971 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:14:33,971 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:33,972 DEBUG [RS-EventLoopGroup-7-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK] 2023-07-18 18:14:33,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; CloseRegionProcedure d6adb109ae18a073027d49e3dc8869d7, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:33,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=13, state=RUNNABLE; CloseRegionProcedure 99483aa0b47f744a4342bbff898effe0, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:33,981 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1400): LOCK_EVENT_WAIT pid=16, ppid=14, state=RUNNABLE; CloseRegionProcedure d6adb109ae18a073027d49e3dc8869d7, server=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,986 DEBUG [RS-EventLoopGroup-7-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK] 2023-07-18 18:14:33,986 DEBUG [PEWorker-3] procedure2.ProcedureExecutor(1400): LOCK_EVENT_WAIT pid=17, ppid=13, state=RUNNABLE; CloseRegionProcedure 99483aa0b47f744a4342bbff898effe0, server=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:33,999 INFO [RS:3;jenkins-hbase4:46365] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46365,1689704073486/jenkins-hbase4.apache.org%2C46365%2C1689704073486.1689704073930 2023-07-18 18:14:34,000 DEBUG [RS:3;jenkins-hbase4:46365] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK], DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK]] 2023-07-18 18:14:34,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1588230740 2023-07-18 18:14:34,160 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:14:34,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:14:34,161 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:14:34,161 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:14:34,161 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:14:34,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=3.21 KB heapSize=6.16 KB 2023-07-18 18:14:34,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.03 KB at sequenceid=16 (bloomFilter=false), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/info/4b4dd9cda1b14d629d3e23b8c4e399ba 2023-07-18 18:14:34,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=184 B at sequenceid=16 (bloomFilter=false), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/table/11f997d24832439eaeafca4ff3b307b0 2023-07-18 18:14:34,446 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/info/4b4dd9cda1b14d629d3e23b8c4e399ba as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/4b4dd9cda1b14d629d3e23b8c4e399ba 2023-07-18 18:14:34,459 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/4b4dd9cda1b14d629d3e23b8c4e399ba, entries=22, sequenceid=16, filesize=7.3 K 2023-07-18 18:14:34,463 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/table/11f997d24832439eaeafca4ff3b307b0 as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/11f997d24832439eaeafca4ff3b307b0 2023-07-18 18:14:34,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/11f997d24832439eaeafca4ff3b307b0, entries=4, sequenceid=16, filesize=4.8 K 2023-07-18 18:14:34,489 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.21 KB/3290, heapSize ~5.88 KB/6024, currentSize=0 B/0 for 1588230740 in 327ms, sequenceid=16, compaction requested=false 2023-07-18 18:14:34,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 18:14:34,515 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/recovered.edits/19.seqid, newMaxSeqId=19, maxSeqId=1 2023-07-18 18:14:34,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:14:34,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:14:34,517 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:14:34,517 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding 1588230740 move to jenkins-hbase4.apache.org,46365,1689704073486 record at close sequenceid=16 2023-07-18 18:14:34,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1588230740 2023-07-18 18:14:34,522 WARN [PEWorker-4] zookeeper.MetaTableLocator(225): Tried to set null ServerName in hbase:meta; skipping -- ServerName required 2023-07-18 18:14:34,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=12 2023-07-18 18:14:34,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; CloseRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36811,1689704069850 in 552 msec 2023-07-18 18:14:34,527 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:34,677 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:34,677 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46365,1689704073486, state=OPENING 2023-07-18 18:14:34,679 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:14:34,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=12, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:34,679 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:34,834 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:34,835 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:34,838 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:34,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 18:14:34,844 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:34,853 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46365%2C1689704073486.meta, suffix=.meta, logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46365,1689704073486, archiveDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs, maxLogs=32 2023-07-18 18:14:34,877 DEBUG [RS-EventLoopGroup-7-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK] 2023-07-18 18:14:34,878 DEBUG [RS-EventLoopGroup-7-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK] 2023-07-18 18:14:34,878 DEBUG [RS-EventLoopGroup-7-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK] 2023-07-18 18:14:34,884 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46365,1689704073486/jenkins-hbase4.apache.org%2C46365%2C1689704073486.meta.1689704074854.meta 2023-07-18 18:14:34,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK], DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK]] 2023-07-18 18:14:34,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:34,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:14:34,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 18:14:34,889 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 18:14:34,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 18:14:34,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:34,890 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 18:14:34,890 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 18:14:34,892 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:14:34,894 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info 2023-07-18 18:14:34,894 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info 2023-07-18 18:14:34,894 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:14:34,915 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/4b4dd9cda1b14d629d3e23b8c4e399ba 2023-07-18 18:14:34,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:34,917 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:14:34,918 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:34,918 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:34,919 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:14:34,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:34,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:14:34,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table 2023-07-18 18:14:34,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table 2023-07-18 18:14:34,922 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:14:34,946 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/11f997d24832439eaeafca4ff3b307b0 2023-07-18 18:14:34,947 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:34,948 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740 2023-07-18 18:14:34,951 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740 2023-07-18 18:14:34,955 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:14:34,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:14:34,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=20; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9562476320, jitterRate=-0.10942499339580536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:14:34,960 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:14:34,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=12 2023-07-18 18:14:34,961 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=18, masterSystemTime=1689704074834 2023-07-18 18:14:34,967 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 18:14:34,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 18:14:34,969 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46365,1689704073486, state=OPEN 2023-07-18 18:14:34,970 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:14:34,970 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:34,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=12 2023-07-18 18:14:34,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=12, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46365,1689704073486 in 291 msec 2023-07-18 18:14:34,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, REOPEN/MOVE in 1.0250 sec 2023-07-18 18:14:35,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d6adb109ae18a073027d49e3dc8869d7, disabling compactions & flushes 2023-07-18 18:14:35,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. after waiting 0 ms 2023-07-18 18:14:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:35,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d6adb109ae18a073027d49e3dc8869d7 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-18 18:14:35,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/.tmp/info/3910e7e809a34efeacebcaefd1237bf3 2023-07-18 18:14:35,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/.tmp/info/3910e7e809a34efeacebcaefd1237bf3 as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/info/3910e7e809a34efeacebcaefd1237bf3 2023-07-18 18:14:35,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/info/3910e7e809a34efeacebcaefd1237bf3, entries=2, sequenceid=6, filesize=4.8 K 2023-07-18 18:14:35,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d6adb109ae18a073027d49e3dc8869d7 in 93ms, sequenceid=6, compaction requested=false 2023-07-18 18:14:35,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 18:14:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:14:35,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:35,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d6adb109ae18a073027d49e3dc8869d7: 2023-07-18 18:14:35,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding d6adb109ae18a073027d49e3dc8869d7 move to jenkins-hbase4.apache.org,46845,1689704069644 record at close sequenceid=6 2023-07-18 18:14:35,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 99483aa0b47f744a4342bbff898effe0, disabling compactions & flushes 2023-07-18 18:14:35,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:35,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:35,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. after waiting 0 ms 2023-07-18 18:14:35,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:35,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 99483aa0b47f744a4342bbff898effe0 1/1 column families, dataSize=1.38 KB heapSize=2.37 KB 2023-07-18 18:14:35,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d6adb109ae18a073027d49e3dc8869d7, regionState=CLOSED 2023-07-18 18:14:35,237 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704075236"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704075236"}]},"ts":"1689704075236"} 2023-07-18 18:14:35,238 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36811] ipc.CallRunner(144): callId: 42 service: ClientService methodName: Mutate size: 217 connection: 172.31.14.131:60668 deadline: 1689704135237, exception=org.apache.hadoop.hbase.exceptions.RegionMovedException: Region moved to: hostname=jenkins-hbase4.apache.org port=46365 startCode=1689704073486. As of locationSeqNum=16. 2023-07-18 18:14:35,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.38 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/.tmp/m/e2e47e5a6afe440880e7bbb99db443e5 2023-07-18 18:14:35,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/.tmp/m/e2e47e5a6afe440880e7bbb99db443e5 as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m/e2e47e5a6afe440880e7bbb99db443e5 2023-07-18 18:14:35,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m/e2e47e5a6afe440880e7bbb99db443e5, entries=3, sequenceid=9, filesize=5.2 K 2023-07-18 18:14:35,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~1.38 KB/1418, heapSize ~2.35 KB/2408, currentSize=0 B/0 for 99483aa0b47f744a4342bbff898effe0 in 73ms, sequenceid=9, compaction requested=false 2023-07-18 18:14:35,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:rsgroup' 2023-07-18 18:14:35,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-07-18 18:14:35,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:14:35,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:35,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 99483aa0b47f744a4342bbff898effe0: 2023-07-18 18:14:35,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding 99483aa0b47f744a4342bbff898effe0 move to jenkins-hbase4.apache.org,46845,1689704069644 record at close sequenceid=9 2023-07-18 18:14:35,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,322 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=99483aa0b47f744a4342bbff898effe0, regionState=CLOSED 2023-07-18 18:14:35,322 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704075322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704075322"}]},"ts":"1689704075322"} 2023-07-18 18:14:35,322 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:35,323 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:35,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=13 2023-07-18 18:14:35,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=13, state=SUCCESS; CloseRegionProcedure 99483aa0b47f744a4342bbff898effe0, server=jenkins-hbase4.apache.org,43237,1689704069417 in 1.3490 sec 2023-07-18 18:14:35,331 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:rsgroup, region=99483aa0b47f744a4342bbff898effe0, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:35,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-18 18:14:35,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; CloseRegionProcedure d6adb109ae18a073027d49e3dc8869d7, server=jenkins-hbase4.apache.org,43237,1689704069417 in 1.3670 sec 2023-07-18 18:14:35,347 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d6adb109ae18a073027d49e3dc8869d7, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:35,347 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:14:35,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=99483aa0b47f744a4342bbff898effe0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:35,348 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704075347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704075347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704075347"}]},"ts":"1689704075347"} 2023-07-18 18:14:35,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d6adb109ae18a073027d49e3dc8869d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:35,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704075348"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704075348"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704075348"}]},"ts":"1689704075348"} 2023-07-18 18:14:35,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=19, ppid=13, state=RUNNABLE; OpenRegionProcedure 99483aa0b47f744a4342bbff898effe0, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:35,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=14, state=RUNNABLE; OpenRegionProcedure d6adb109ae18a073027d49e3dc8869d7, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:35,505 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:35,505 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:35,509 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:35,514 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:35,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d6adb109ae18a073027d49e3dc8869d7, NAME => 'hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:35,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:35,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,517 INFO [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,518 DEBUG [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/info 2023-07-18 18:14:35,518 DEBUG [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/info 2023-07-18 18:14:35,519 INFO [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d6adb109ae18a073027d49e3dc8869d7 columnFamilyName info 2023-07-18 18:14:35,529 DEBUG [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/info/3910e7e809a34efeacebcaefd1237bf3 2023-07-18 18:14:35,530 INFO [StoreOpener-d6adb109ae18a073027d49e3dc8869d7-1] regionserver.HStore(310): Store=d6adb109ae18a073027d49e3dc8869d7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:35,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:35,540 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d6adb109ae18a073027d49e3dc8869d7; next sequenceid=10; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10456981440, jitterRate=-0.026117712259292603}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:35,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d6adb109ae18a073027d49e3dc8869d7: 2023-07-18 18:14:35,544 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7., pid=20, masterSystemTime=1689704075504 2023-07-18 18:14:35,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:35,549 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:35,549 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:35,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99483aa0b47f744a4342bbff898effe0, NAME => 'hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:35,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:14:35,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. service=MultiRowMutationService 2023-07-18 18:14:35,550 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d6adb109ae18a073027d49e3dc8869d7, regionState=OPEN, openSeqNum=10, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:35,550 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:rsgroup successfully. 2023-07-18 18:14:35,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table rsgroup 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:35,550 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704075550"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704075550"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704075550"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704075550"}]},"ts":"1689704075550"} 2023-07-18 18:14:35,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,553 INFO [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family m of region 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,555 DEBUG [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m 2023-07-18 18:14:35,555 DEBUG [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m 2023-07-18 18:14:35,556 INFO [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99483aa0b47f744a4342bbff898effe0 columnFamilyName m 2023-07-18 18:14:35,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=14 2023-07-18 18:14:35,559 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=14, state=SUCCESS; OpenRegionProcedure d6adb109ae18a073027d49e3dc8869d7, server=jenkins-hbase4.apache.org,46845,1689704069644 in 203 msec 2023-07-18 18:14:35,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d6adb109ae18a073027d49e3dc8869d7, REOPEN/MOVE in 1.6020 sec 2023-07-18 18:14:35,570 DEBUG [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m/e2e47e5a6afe440880e7bbb99db443e5 2023-07-18 18:14:35,570 INFO [StoreOpener-99483aa0b47f744a4342bbff898effe0-1] regionserver.HStore(310): Store=99483aa0b47f744a4342bbff898effe0/m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:35,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,579 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:35,580 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 99483aa0b47f744a4342bbff898effe0; next sequenceid=13; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@37bf7981, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:35,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 99483aa0b47f744a4342bbff898effe0: 2023-07-18 18:14:35,582 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0., pid=19, masterSystemTime=1689704075504 2023-07-18 18:14:35,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:35,584 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:35,585 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=99483aa0b47f744a4342bbff898effe0, regionState=OPEN, openSeqNum=13, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:35,585 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704075585"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704075585"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704075585"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704075585"}]},"ts":"1689704075585"} 2023-07-18 18:14:35,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=13 2023-07-18 18:14:35,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=13, state=SUCCESS; OpenRegionProcedure 99483aa0b47f744a4342bbff898effe0, server=jenkins-hbase4.apache.org,46845,1689704069644 in 238 msec 2023-07-18 18:14:35,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; TransitRegionStateProcedure table=hbase:rsgroup, region=99483aa0b47f744a4342bbff898effe0, REOPEN/MOVE in 1.6420 sec 2023-07-18 18:14:35,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417] are moved back to default 2023-07-18 18:14:35,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: default => Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:35,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:35,963 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43237] ipc.CallRunner(144): callId: 3 service: ClientService methodName: Scan size: 136 connection: 172.31.14.131:39566 deadline: 1689704135962, exception=org.apache.hadoop.hbase.exceptions.RegionMovedException: Region moved to: hostname=jenkins-hbase4.apache.org port=46845 startCode=1689704069644. As of locationSeqNum=9. 2023-07-18 18:14:36,066 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36811] ipc.CallRunner(144): callId: 4 service: ClientService methodName: Get size: 88 connection: 172.31.14.131:60688 deadline: 1689704136066, exception=org.apache.hadoop.hbase.exceptions.RegionMovedException: Region moved to: hostname=jenkins-hbase4.apache.org port=46365 startCode=1689704073486. As of locationSeqNum=16. 2023-07-18 18:14:36,169 DEBUG [hconnection-0x120ad869-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:36,195 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:36,212 DEBUG [hconnection-0x120ad869-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:36,232 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:36,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:36,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:36,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:36,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:36,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:36,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:36,275 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=21, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=Group_testTableMoveTruncateAndDrop execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:36,278 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43237] ipc.CallRunner(144): callId: 50 service: ClientService methodName: ExecService size: 622 connection: 172.31.14.131:39550 deadline: 1689704136278, exception=org.apache.hadoop.hbase.exceptions.RegionMovedException: Region moved to: hostname=jenkins-hbase4.apache.org port=46845 startCode=1689704069644. As of locationSeqNum=9. 2023-07-18 18:14:36,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "Group_testTableMoveTruncateAndDrop" procId is: 21 2023-07-18 18:14:36,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:14:36,384 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:36,385 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:36,388 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:36,389 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:36,389 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:36,390 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:36,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:14:36,401 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=21, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=Group_testTableMoveTruncateAndDrop execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:36,407 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:36,407 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:36,408 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:36,408 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:36,408 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:36,408 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 empty. 2023-07-18 18:14:36,409 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db empty. 2023-07-18 18:14:36,409 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 empty. 2023-07-18 18:14:36,414 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:36,415 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa empty. 2023-07-18 18:14:36,415 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 empty. 2023-07-18 18:14:36,416 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:36,416 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:36,417 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:36,418 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:36,419 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived Group_testTableMoveTruncateAndDrop regions 2023-07-18 18:14:36,452 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:36,454 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(7675): creating {ENCODED => fb2dc29be66c8f7b880ddec041515019, NAME => 'Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:36,455 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(7675): creating {ENCODED => c48c7ce5ce2f72998b458ab16caad8db, NAME => 'Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:36,455 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(7675): creating {ENCODED => e64188b531d7d823e8cb0f2ff388ee87, NAME => 'Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.', STARTKEY => '', ENDKEY => 'aaaaa'}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:36,521 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:36,525 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1604): Closing fb2dc29be66c8f7b880ddec041515019, disabling compactions & flushes 2023-07-18 18:14:36,525 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:36,525 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:36,525 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. after waiting 0 ms 2023-07-18 18:14:36,525 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:36,525 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:36,526 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1558): Region close journal for fb2dc29be66c8f7b880ddec041515019: 2023-07-18 18:14:36,527 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(7675): creating {ENCODED => 11deb0c26551d5972e7a7e6192463f73, NAME => 'Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:36,538 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:36,539 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1604): Closing e64188b531d7d823e8cb0f2ff388ee87, disabling compactions & flushes 2023-07-18 18:14:36,539 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:36,539 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:36,539 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. after waiting 0 ms 2023-07-18 18:14:36,539 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:36,539 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:36,539 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1558): Region close journal for e64188b531d7d823e8cb0f2ff388ee87: 2023-07-18 18:14:36,540 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb2b45ee64be88ff38963467ba16c2aa, NAME => 'Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.', STARTKEY => 'zzzzz', ENDKEY => ''}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:36,545 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:36,546 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1604): Closing c48c7ce5ce2f72998b458ab16caad8db, disabling compactions & flushes 2023-07-18 18:14:36,546 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:36,546 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:36,546 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. after waiting 0 ms 2023-07-18 18:14:36,546 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:36,546 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:36,546 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1558): Region close journal for c48c7ce5ce2f72998b458ab16caad8db: 2023-07-18 18:14:36,595 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:36,596 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1604): Closing 11deb0c26551d5972e7a7e6192463f73, disabling compactions & flushes 2023-07-18 18:14:36,596 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:36,596 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:36,596 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. after waiting 0 ms 2023-07-18 18:14:36,596 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:36,596 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:36,596 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1558): Region close journal for 11deb0c26551d5972e7a7e6192463f73: 2023-07-18 18:14:36,597 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:36,597 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1604): Closing bb2b45ee64be88ff38963467ba16c2aa, disabling compactions & flushes 2023-07-18 18:14:36,597 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:36,597 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:36,597 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. after waiting 0 ms 2023-07-18 18:14:36,597 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:36,597 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:36,597 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1558): Region close journal for bb2b45ee64be88ff38963467ba16c2aa: 2023-07-18 18:14:36,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:14:36,602 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=21, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=Group_testTableMoveTruncateAndDrop execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:36,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704076603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704076603"}]},"ts":"1689704076603"} 2023-07-18 18:14:36,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704076603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704076603"}]},"ts":"1689704076603"} 2023-07-18 18:14:36,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704076603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704076603"}]},"ts":"1689704076603"} 2023-07-18 18:14:36,604 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704076603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704076603"}]},"ts":"1689704076603"} 2023-07-18 18:14:36,604 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704076603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704076603"}]},"ts":"1689704076603"} 2023-07-18 18:14:36,710 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 5 regions to meta. 2023-07-18 18:14:36,712 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=21, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=Group_testTableMoveTruncateAndDrop execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:36,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704076712"}]},"ts":"1689704076712"} 2023-07-18 18:14:36,715 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=Group_testTableMoveTruncateAndDrop, state=ENABLING in hbase:meta 2023-07-18 18:14:36,720 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:36,720 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:36,720 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:36,720 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:36,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, ASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, ASSIGN}, {pid=24, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, ASSIGN}, {pid=25, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, ASSIGN}, {pid=26, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, ASSIGN}] 2023-07-18 18:14:36,724 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=26, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, ASSIGN 2023-07-18 18:14:36,724 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=25, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, ASSIGN 2023-07-18 18:14:36,727 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, ASSIGN 2023-07-18 18:14:36,727 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, ASSIGN 2023-07-18 18:14:36,729 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, ASSIGN 2023-07-18 18:14:36,729 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=26, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:36,729 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=25, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:36,730 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:36,730 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:36,732 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:36,879 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 5 regions. 5 retained the pre-restart assignment. 2023-07-18 18:14:36,885 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=bb2b45ee64be88ff38963467ba16c2aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:36,885 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704076885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704076885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704076885"}]},"ts":"1689704076885"} 2023-07-18 18:14:36,886 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fb2dc29be66c8f7b880ddec041515019, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:36,886 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704076886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704076886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704076886"}]},"ts":"1689704076886"} 2023-07-18 18:14:36,887 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c48c7ce5ce2f72998b458ab16caad8db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:36,887 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e64188b531d7d823e8cb0f2ff388ee87, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:36,887 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=11deb0c26551d5972e7a7e6192463f73, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:36,887 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704076887"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704076887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704076887"}]},"ts":"1689704076887"} 2023-07-18 18:14:36,887 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704076887"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704076887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704076887"}]},"ts":"1689704076887"} 2023-07-18 18:14:36,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704076887"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704076887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704076887"}]},"ts":"1689704076887"} 2023-07-18 18:14:36,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=26, state=RUNNABLE; OpenRegionProcedure bb2b45ee64be88ff38963467ba16c2aa, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:36,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=23, state=RUNNABLE; OpenRegionProcedure c48c7ce5ce2f72998b458ab16caad8db, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:36,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=24, state=RUNNABLE; OpenRegionProcedure fb2dc29be66c8f7b880ddec041515019, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:36,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:14:36,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=22, state=RUNNABLE; OpenRegionProcedure e64188b531d7d823e8cb0f2ff388ee87, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:36,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=25, state=RUNNABLE; OpenRegionProcedure 11deb0c26551d5972e7a7e6192463f73, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:37,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:37,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb2dc29be66c8f7b880ddec041515019, NAME => 'Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'} 2023-07-18 18:14:37,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:37,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,059 INFO [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,061 DEBUG [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/f 2023-07-18 18:14:37,061 DEBUG [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/f 2023-07-18 18:14:37,062 INFO [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb2dc29be66c8f7b880ddec041515019 columnFamilyName f 2023-07-18 18:14:37,063 INFO [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] regionserver.HStore(310): Store=fb2dc29be66c8f7b880ddec041515019/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:37,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:37,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb2dc29be66c8f7b880ddec041515019; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9554149600, jitterRate=-0.11020047962665558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:37,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb2dc29be66c8f7b880ddec041515019: 2023-07-18 18:14:37,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11deb0c26551d5972e7a7e6192463f73, NAME => 'Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'} 2023-07-18 18:14:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019., pid=29, masterSystemTime=1689704077050 2023-07-18 18:14:37,083 INFO [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:37,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:37,085 DEBUG [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/f 2023-07-18 18:14:37,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:37,086 DEBUG [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/f 2023-07-18 18:14:37,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb2b45ee64be88ff38963467ba16c2aa, NAME => 'Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.', STARTKEY => 'zzzzz', ENDKEY => ''} 2023-07-18 18:14:37,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,086 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fb2dc29be66c8f7b880ddec041515019, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:37,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:37,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,086 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077086"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704077086"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704077086"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704077086"}]},"ts":"1689704077086"} 2023-07-18 18:14:37,087 INFO [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11deb0c26551d5972e7a7e6192463f73 columnFamilyName f 2023-07-18 18:14:37,088 INFO [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] regionserver.HStore(310): Store=11deb0c26551d5972e7a7e6192463f73/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:37,089 INFO [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,093 DEBUG [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/f 2023-07-18 18:14:37,093 DEBUG [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/f 2023-07-18 18:14:37,094 INFO [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb2b45ee64be88ff38963467ba16c2aa columnFamilyName f 2023-07-18 18:14:37,095 INFO [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] regionserver.HStore(310): Store=bb2b45ee64be88ff38963467ba16c2aa/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:37,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=24 2023-07-18 18:14:37,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=24, state=SUCCESS; OpenRegionProcedure fb2dc29be66c8f7b880ddec041515019, server=jenkins-hbase4.apache.org,46845,1689704069644 in 194 msec 2023-07-18 18:14:37,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, ASSIGN in 377 msec 2023-07-18 18:14:37,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:37,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb2b45ee64be88ff38963467ba16c2aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10390305760, jitterRate=-0.03232736885547638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:37,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb2b45ee64be88ff38963467ba16c2aa: 2023-07-18 18:14:37,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa., pid=27, masterSystemTime=1689704077050 2023-07-18 18:14:37,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:37,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 11deb0c26551d5972e7a7e6192463f73; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10218040960, jitterRate=-0.04837077856063843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:37,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 11deb0c26551d5972e7a7e6192463f73: 2023-07-18 18:14:37,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:37,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:37,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:37,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c48c7ce5ce2f72998b458ab16caad8db, NAME => 'Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'} 2023-07-18 18:14:37,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:37,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,124 INFO [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,126 DEBUG [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/f 2023-07-18 18:14:37,126 DEBUG [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/f 2023-07-18 18:14:37,127 INFO [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c48c7ce5ce2f72998b458ab16caad8db columnFamilyName f 2023-07-18 18:14:37,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73., pid=31, masterSystemTime=1689704077074 2023-07-18 18:14:37,128 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=26 updating hbase:meta row=bb2b45ee64be88ff38963467ba16c2aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:37,129 INFO [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] regionserver.HStore(310): Store=c48c7ce5ce2f72998b458ab16caad8db/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:37,129 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704077128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704077128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704077128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704077128"}]},"ts":"1689704077128"} 2023-07-18 18:14:37,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:37,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:37,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:37,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e64188b531d7d823e8cb0f2ff388ee87, NAME => 'Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.', STARTKEY => '', ENDKEY => 'aaaaa'} 2023-07-18 18:14:37,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:37,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,133 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=25 updating hbase:meta row=11deb0c26551d5972e7a7e6192463f73, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:37,133 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077133"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704077133"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704077133"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704077133"}]},"ts":"1689704077133"} 2023-07-18 18:14:37,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=26 2023-07-18 18:14:37,139 INFO [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=26, state=SUCCESS; OpenRegionProcedure bb2b45ee64be88ff38963467ba16c2aa, server=jenkins-hbase4.apache.org,46845,1689704069644 in 242 msec 2023-07-18 18:14:37,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, ASSIGN in 416 msec 2023-07-18 18:14:37,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:37,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c48c7ce5ce2f72998b458ab16caad8db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10199669760, jitterRate=-0.050081729888916016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:37,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c48c7ce5ce2f72998b458ab16caad8db: 2023-07-18 18:14:37,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db., pid=28, masterSystemTime=1689704077050 2023-07-18 18:14:37,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=25 2023-07-18 18:14:37,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=25, state=SUCCESS; OpenRegionProcedure 11deb0c26551d5972e7a7e6192463f73, server=jenkins-hbase4.apache.org,46365,1689704073486 in 222 msec 2023-07-18 18:14:37,148 DEBUG [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/f 2023-07-18 18:14:37,148 DEBUG [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/f 2023-07-18 18:14:37,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:37,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:37,149 INFO [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64188b531d7d823e8cb0f2ff388ee87 columnFamilyName f 2023-07-18 18:14:37,150 INFO [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] regionserver.HStore(310): Store=e64188b531d7d823e8cb0f2ff388ee87/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:37,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,154 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c48c7ce5ce2f72998b458ab16caad8db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:37,154 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077154"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704077154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704077154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704077154"}]},"ts":"1689704077154"} 2023-07-18 18:14:37,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, ASSIGN in 426 msec 2023-07-18 18:14:37,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:37,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e64188b531d7d823e8cb0f2ff388ee87; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11542100000, jitterRate=0.07494182884693146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:37,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e64188b531d7d823e8cb0f2ff388ee87: 2023-07-18 18:14:37,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87., pid=30, masterSystemTime=1689704077074 2023-07-18 18:14:37,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=23 2023-07-18 18:14:37,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=23, state=SUCCESS; OpenRegionProcedure c48c7ce5ce2f72998b458ab16caad8db, server=jenkins-hbase4.apache.org,46845,1689704069644 in 262 msec 2023-07-18 18:14:37,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, ASSIGN in 441 msec 2023-07-18 18:14:37,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:37,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:37,166 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e64188b531d7d823e8cb0f2ff388ee87, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:37,166 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704077166"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704077166"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704077166"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704077166"}]},"ts":"1689704077166"} 2023-07-18 18:14:37,171 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=22 2023-07-18 18:14:37,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=22, state=SUCCESS; OpenRegionProcedure e64188b531d7d823e8cb0f2ff388ee87, server=jenkins-hbase4.apache.org,46365,1689704073486 in 253 msec 2023-07-18 18:14:37,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-18 18:14:37,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, ASSIGN in 451 msec 2023-07-18 18:14:37,176 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=21, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=Group_testTableMoveTruncateAndDrop execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:37,176 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704077176"}]},"ts":"1689704077176"} 2023-07-18 18:14:37,178 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=Group_testTableMoveTruncateAndDrop, state=ENABLED in hbase:meta 2023-07-18 18:14:37,183 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=21, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=Group_testTableMoveTruncateAndDrop execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:37,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; CreateTableProcedure table=Group_testTableMoveTruncateAndDrop in 912 msec 2023-07-18 18:14:37,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:14:37,404 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:Group_testTableMoveTruncateAndDrop, procId: 21 completed 2023-07-18 18:14:37,404 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(3430): Waiting until all regions of table Group_testTableMoveTruncateAndDrop get assigned. Timeout = 60000ms 2023-07-18 18:14:37,406 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:37,408 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36811] ipc.CallRunner(144): callId: 49 service: ClientService methodName: Scan size: 95 connection: 172.31.14.131:60686 deadline: 1689704137408, exception=org.apache.hadoop.hbase.exceptions.RegionMovedException: Region moved to: hostname=jenkins-hbase4.apache.org port=46365 startCode=1689704073486. As of locationSeqNum=16. 2023-07-18 18:14:37,511 DEBUG [hconnection-0x497c82a-shared-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:37,513 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:37,526 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3484): All regions for table Group_testTableMoveTruncateAndDrop assigned to meta. Checking AM states. 2023-07-18 18:14:37,527 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:37,527 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3504): All regions for table Group_testTableMoveTruncateAndDrop assigned. 2023-07-18 18:14:37,527 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:37,533 DEBUG [Listener at localhost/35951] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:37,535 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:37,539 DEBUG [Listener at localhost/35951] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:37,541 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:37,541 DEBUG [Listener at localhost/35951] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:37,544 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:37,546 DEBUG [Listener at localhost/35951] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:37,551 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:37,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:37,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:37,567 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsAdmin1(307): Moving table Group_testTableMoveTruncateAndDrop to Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [Group_testTableMoveTruncateAndDrop] to rsgroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:37,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:37,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:37,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table Group_testTableMoveTruncateAndDrop to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region e64188b531d7d823e8cb0f2ff388ee87 to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:37,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, REOPEN/MOVE 2023-07-18 18:14:37,593 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, REOPEN/MOVE 2023-07-18 18:14:37,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region c48c7ce5ce2f72998b458ab16caad8db to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:37,595 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=e64188b531d7d823e8cb0f2ff388ee87, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:37,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704077594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077594"}]},"ts":"1689704077594"} 2023-07-18 18:14:37,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, REOPEN/MOVE 2023-07-18 18:14:37,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region fb2dc29be66c8f7b880ddec041515019 to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,596 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, REOPEN/MOVE 2023-07-18 18:14:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:37,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:37,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=35, ppid=32, state=RUNNABLE; CloseRegionProcedure e64188b531d7d823e8cb0f2ff388ee87, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:37,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=c48c7ce5ce2f72998b458ab16caad8db, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:37,598 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077598"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077598"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077598"}]},"ts":"1689704077598"} 2023-07-18 18:14:37,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, REOPEN/MOVE 2023-07-18 18:14:37,601 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, REOPEN/MOVE 2023-07-18 18:14:37,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region 11deb0c26551d5972e7a7e6192463f73 to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:37,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=33, state=RUNNABLE; CloseRegionProcedure c48c7ce5ce2f72998b458ab16caad8db, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:37,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:37,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:37,605 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=fb2dc29be66c8f7b880ddec041515019, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:37,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:37,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:37,605 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077605"}]},"ts":"1689704077605"} 2023-07-18 18:14:37,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=37, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, REOPEN/MOVE 2023-07-18 18:14:37,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region bb2b45ee64be88ff38963467ba16c2aa to RSGroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:37,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:37,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:37,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:37,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:37,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:37,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=34, state=RUNNABLE; CloseRegionProcedure fb2dc29be66c8f7b880ddec041515019, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:37,612 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, REOPEN/MOVE 2023-07-18 18:14:37,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, REOPEN/MOVE 2023-07-18 18:14:37,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 5 region(s) to group Group_testTableMoveTruncateAndDrop_1994555507, current retry=0 2023-07-18 18:14:37,614 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=11deb0c26551d5972e7a7e6192463f73, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:37,614 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077614"}]},"ts":"1689704077614"} 2023-07-18 18:14:37,615 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, REOPEN/MOVE 2023-07-18 18:14:37,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 11deb0c26551d5972e7a7e6192463f73, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:37,618 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bb2b45ee64be88ff38963467ba16c2aa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:37,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704077618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077618"}]},"ts":"1689704077618"} 2023-07-18 18:14:37,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=38, state=RUNNABLE; CloseRegionProcedure bb2b45ee64be88ff38963467ba16c2aa, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:37,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e64188b531d7d823e8cb0f2ff388ee87, disabling compactions & flushes 2023-07-18 18:14:37,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:37,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:37,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. after waiting 0 ms 2023-07-18 18:14:37,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:37,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb2dc29be66c8f7b880ddec041515019, disabling compactions & flushes 2023-07-18 18:14:37,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. after waiting 0 ms 2023-07-18 18:14:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:37,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:37,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:37,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e64188b531d7d823e8cb0f2ff388ee87: 2023-07-18 18:14:37,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding e64188b531d7d823e8cb0f2ff388ee87 move to jenkins-hbase4.apache.org,43237,1689704069417 record at close sequenceid=2 2023-07-18 18:14:37,780 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-18 18:14:37,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:37,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:37,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb2dc29be66c8f7b880ddec041515019: 2023-07-18 18:14:37,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding fb2dc29be66c8f7b880ddec041515019 move to jenkins-hbase4.apache.org,43237,1689704069417 record at close sequenceid=2 2023-07-18 18:14:37,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:37,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,792 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=e64188b531d7d823e8cb0f2ff388ee87, regionState=CLOSED 2023-07-18 18:14:37,793 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704077792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704077792"}]},"ts":"1689704077792"} 2023-07-18 18:14:37,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:37,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,794 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=fb2dc29be66c8f7b880ddec041515019, regionState=CLOSED 2023-07-18 18:14:37,794 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704077794"}]},"ts":"1689704077794"} 2023-07-18 18:14:37,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 11deb0c26551d5972e7a7e6192463f73, disabling compactions & flushes 2023-07-18 18:14:37,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:37,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:37,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. after waiting 0 ms 2023-07-18 18:14:37,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:37,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb2b45ee64be88ff38963467ba16c2aa, disabling compactions & flushes 2023-07-18 18:14:37,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:37,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:37,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. after waiting 0 ms 2023-07-18 18:14:37,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:37,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=32 2023-07-18 18:14:37,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=32, state=SUCCESS; CloseRegionProcedure e64188b531d7d823e8cb0f2ff388ee87, server=jenkins-hbase4.apache.org,46365,1689704073486 in 197 msec 2023-07-18 18:14:37,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=34 2023-07-18 18:14:37,804 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=32, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:37,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=34, state=SUCCESS; CloseRegionProcedure fb2dc29be66c8f7b880ddec041515019, server=jenkins-hbase4.apache.org,46845,1689704069644 in 188 msec 2023-07-18 18:14:37,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:37,819 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=34, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:37,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:37,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 11deb0c26551d5972e7a7e6192463f73: 2023-07-18 18:14:37,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding 11deb0c26551d5972e7a7e6192463f73 move to jenkins-hbase4.apache.org,43237,1689704069417 record at close sequenceid=2 2023-07-18 18:14:37,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:37,825 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=11deb0c26551d5972e7a7e6192463f73, regionState=CLOSED 2023-07-18 18:14:37,825 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704077825"}]},"ts":"1689704077825"} 2023-07-18 18:14:37,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:37,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:37,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb2b45ee64be88ff38963467ba16c2aa: 2023-07-18 18:14:37,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding bb2b45ee64be88ff38963467ba16c2aa move to jenkins-hbase4.apache.org,36811,1689704069850 record at close sequenceid=2 2023-07-18 18:14:37,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-18 18:14:37,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 11deb0c26551d5972e7a7e6192463f73, server=jenkins-hbase4.apache.org,46365,1689704073486 in 211 msec 2023-07-18 18:14:37,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:37,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c48c7ce5ce2f72998b458ab16caad8db, disabling compactions & flushes 2023-07-18 18:14:37,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:37,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:37,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. after waiting 0 ms 2023-07-18 18:14:37,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:37,834 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bb2b45ee64be88ff38963467ba16c2aa, regionState=CLOSED 2023-07-18 18:14:37,834 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704077834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704077834"}]},"ts":"1689704077834"} 2023-07-18 18:14:37,841 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=37, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:37,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=38 2023-07-18 18:14:37,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=38, state=SUCCESS; CloseRegionProcedure bb2b45ee64be88ff38963467ba16c2aa, server=jenkins-hbase4.apache.org,46845,1689704069644 in 216 msec 2023-07-18 18:14:37,847 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=38, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36811,1689704069850; forceNewPlan=false, retain=false 2023-07-18 18:14:37,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:37,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:37,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c48c7ce5ce2f72998b458ab16caad8db: 2023-07-18 18:14:37,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding c48c7ce5ce2f72998b458ab16caad8db move to jenkins-hbase4.apache.org,43237,1689704069417 record at close sequenceid=2 2023-07-18 18:14:37,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:37,858 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=c48c7ce5ce2f72998b458ab16caad8db, regionState=CLOSED 2023-07-18 18:14:37,859 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704077858"}]},"ts":"1689704077858"} 2023-07-18 18:14:37,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-07-18 18:14:37,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; CloseRegionProcedure c48c7ce5ce2f72998b458ab16caad8db, server=jenkins-hbase4.apache.org,46845,1689704069644 in 259 msec 2023-07-18 18:14:37,866 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=33, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:37,906 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver 2023-07-18 18:14:37,906 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver Metrics about HBase MasterObservers 2023-07-18 18:14:37,907 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:14:37,907 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 18:14:37,907 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint 2023-07-18 18:14:37,907 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint Metrics about HBase MasterObservers 2023-07-18 18:14:37,955 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 5 regions. 5 retained the pre-restart assignment. 2023-07-18 18:14:37,955 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=11deb0c26551d5972e7a7e6192463f73, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:37,955 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bb2b45ee64be88ff38963467ba16c2aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:37,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=c48c7ce5ce2f72998b458ab16caad8db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:37,955 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=e64188b531d7d823e8cb0f2ff388ee87, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:37,955 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=fb2dc29be66c8f7b880ddec041515019, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:37,956 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704077955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077955"}]},"ts":"1689704077955"} 2023-07-18 18:14:37,956 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077955"}]},"ts":"1689704077955"} 2023-07-18 18:14:37,956 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077955"}]},"ts":"1689704077955"} 2023-07-18 18:14:37,956 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704077955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077955"}]},"ts":"1689704077955"} 2023-07-18 18:14:37,956 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704077955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704077955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704077955"}]},"ts":"1689704077955"} 2023-07-18 18:14:37,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=42, ppid=38, state=RUNNABLE; OpenRegionProcedure bb2b45ee64be88ff38963467ba16c2aa, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:37,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=37, state=RUNNABLE; OpenRegionProcedure 11deb0c26551d5972e7a7e6192463f73, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:37,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; OpenRegionProcedure fb2dc29be66c8f7b880ddec041515019, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:37,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=33, state=RUNNABLE; OpenRegionProcedure c48c7ce5ce2f72998b458ab16caad8db, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:37,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=32, state=RUNNABLE; OpenRegionProcedure e64188b531d7d823e8cb0f2ff388ee87, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:38,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:38,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb2b45ee64be88ff38963467ba16c2aa, NAME => 'Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.', STARTKEY => 'zzzzz', ENDKEY => ''} 2023-07-18 18:14:38,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:38,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:38,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c48c7ce5ce2f72998b458ab16caad8db, NAME => 'Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'} 2023-07-18 18:14:38,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:38,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,120 INFO [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,123 INFO [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,125 DEBUG [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/f 2023-07-18 18:14:38,125 DEBUG [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/f 2023-07-18 18:14:38,129 INFO [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb2b45ee64be88ff38963467ba16c2aa columnFamilyName f 2023-07-18 18:14:38,129 DEBUG [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/f 2023-07-18 18:14:38,129 DEBUG [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/f 2023-07-18 18:14:38,130 INFO [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c48c7ce5ce2f72998b458ab16caad8db columnFamilyName f 2023-07-18 18:14:38,130 INFO [StoreOpener-bb2b45ee64be88ff38963467ba16c2aa-1] regionserver.HStore(310): Store=bb2b45ee64be88ff38963467ba16c2aa/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:38,131 INFO [StoreOpener-c48c7ce5ce2f72998b458ab16caad8db-1] regionserver.HStore(310): Store=c48c7ce5ce2f72998b458ab16caad8db/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:38,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb2b45ee64be88ff38963467ba16c2aa; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10650143680, jitterRate=-0.008128076791763306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb2b45ee64be88ff38963467ba16c2aa: 2023-07-18 18:14:38,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c48c7ce5ce2f72998b458ab16caad8db; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9798813920, jitterRate=-0.08741433918476105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c48c7ce5ce2f72998b458ab16caad8db: 2023-07-18 18:14:38,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa., pid=42, masterSystemTime=1689704078111 2023-07-18 18:14:38,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db., pid=45, masterSystemTime=1689704078113 2023-07-18 18:14:38,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:38,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:38,145 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bb2b45ee64be88ff38963467ba16c2aa, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:38,145 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704078145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704078145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704078145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704078145"}]},"ts":"1689704078145"} 2023-07-18 18:14:38,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:38,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:38,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:38,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb2dc29be66c8f7b880ddec041515019, NAME => 'Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'} 2023-07-18 18:14:38,146 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=33 updating hbase:meta row=c48c7ce5ce2f72998b458ab16caad8db, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:38,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078146"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704078146"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704078146"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704078146"}]},"ts":"1689704078146"} 2023-07-18 18:14:38,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:38,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,148 INFO [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,149 DEBUG [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/f 2023-07-18 18:14:38,149 DEBUG [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/f 2023-07-18 18:14:38,150 INFO [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb2dc29be66c8f7b880ddec041515019 columnFamilyName f 2023-07-18 18:14:38,150 INFO [StoreOpener-fb2dc29be66c8f7b880ddec041515019-1] regionserver.HStore(310): Store=fb2dc29be66c8f7b880ddec041515019/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:38,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb2dc29be66c8f7b880ddec041515019; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10058829760, jitterRate=-0.06319847702980042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:38,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb2dc29be66c8f7b880ddec041515019: 2023-07-18 18:14:38,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019., pid=44, masterSystemTime=1689704078113 2023-07-18 18:14:38,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=33 2023-07-18 18:14:38,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=33, state=SUCCESS; OpenRegionProcedure c48c7ce5ce2f72998b458ab16caad8db, server=jenkins-hbase4.apache.org,43237,1689704069417 in 189 msec 2023-07-18 18:14:38,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:38,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:38,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:38,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e64188b531d7d823e8cb0f2ff388ee87, NAME => 'Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.', STARTKEY => '', ENDKEY => 'aaaaa'} 2023-07-18 18:14:38,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=38 2023-07-18 18:14:38,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=38, state=SUCCESS; OpenRegionProcedure bb2b45ee64be88ff38963467ba16c2aa, server=jenkins-hbase4.apache.org,36811,1689704069850 in 192 msec 2023-07-18 18:14:38,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:38,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,169 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=fb2dc29be66c8f7b880ddec041515019, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:38,170 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078169"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704078169"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704078169"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704078169"}]},"ts":"1689704078169"} 2023-07-18 18:14:38,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, REOPEN/MOVE in 558 msec 2023-07-18 18:14:38,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, REOPEN/MOVE in 573 msec 2023-07-18 18:14:38,173 INFO [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,175 DEBUG [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/f 2023-07-18 18:14:38,175 DEBUG [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/f 2023-07-18 18:14:38,176 INFO [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e64188b531d7d823e8cb0f2ff388ee87 columnFamilyName f 2023-07-18 18:14:38,177 INFO [StoreOpener-e64188b531d7d823e8cb0f2ff388ee87-1] regionserver.HStore(310): Store=e64188b531d7d823e8cb0f2ff388ee87/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:38,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e64188b531d7d823e8cb0f2ff388ee87; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11083209120, jitterRate=0.0322042852640152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:38,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e64188b531d7d823e8cb0f2ff388ee87: 2023-07-18 18:14:38,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87., pid=46, masterSystemTime=1689704078113 2023-07-18 18:14:38,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:38,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:38,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:38,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11deb0c26551d5972e7a7e6192463f73, NAME => 'Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'} 2023-07-18 18:14:38,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:38,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,192 INFO [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,193 DEBUG [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/f 2023-07-18 18:14:38,194 DEBUG [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/f 2023-07-18 18:14:38,194 INFO [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11deb0c26551d5972e7a7e6192463f73 columnFamilyName f 2023-07-18 18:14:38,195 INFO [StoreOpener-11deb0c26551d5972e7a7e6192463f73-1] regionserver.HStore(310): Store=11deb0c26551d5972e7a7e6192463f73/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:38,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-07-18 18:14:38,199 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; OpenRegionProcedure fb2dc29be66c8f7b880ddec041515019, server=jenkins-hbase4.apache.org,43237,1689704069417 in 211 msec 2023-07-18 18:14:38,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=e64188b531d7d823e8cb0f2ff388ee87, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:38,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704078199"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704078199"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704078199"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704078199"}]},"ts":"1689704078199"} 2023-07-18 18:14:38,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, REOPEN/MOVE in 601 msec 2023-07-18 18:14:38,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=32 2023-07-18 18:14:38,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=32, state=SUCCESS; OpenRegionProcedure e64188b531d7d823e8cb0f2ff388ee87, server=jenkins-hbase4.apache.org,43237,1689704069417 in 238 msec 2023-07-18 18:14:38,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 11deb0c26551d5972e7a7e6192463f73; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11378442400, jitterRate=0.059700027108192444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:38,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 11deb0c26551d5972e7a7e6192463f73: 2023-07-18 18:14:38,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, REOPEN/MOVE in 616 msec 2023-07-18 18:14:38,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73., pid=43, masterSystemTime=1689704078113 2023-07-18 18:14:38,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:38,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:38,212 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=11deb0c26551d5972e7a7e6192463f73, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:38,212 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078212"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704078212"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704078212"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704078212"}]},"ts":"1689704078212"} 2023-07-18 18:14:38,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=37 2023-07-18 18:14:38,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=37, state=SUCCESS; OpenRegionProcedure 11deb0c26551d5972e7a7e6192463f73, server=jenkins-hbase4.apache.org,43237,1689704069417 in 262 msec 2023-07-18 18:14:38,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, REOPEN/MOVE in 625 msec 2023-07-18 18:14:38,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=32 2023-07-18 18:14:38,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [Group_testTableMoveTruncateAndDrop] moved to target group Group_testTableMoveTruncateAndDrop_1994555507. 2023-07-18 18:14:38,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:38,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:38,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:38,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:38,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:38,623 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:38,629 INFO [Listener at localhost/35951] client.HBaseAdmin$15(890): Started disable of Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:38,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:38,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:38,645 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704078644"}]},"ts":"1689704078644"} 2023-07-18 18:14:38,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=47 2023-07-18 18:14:38,646 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=Group_testTableMoveTruncateAndDrop, state=DISABLING in hbase:meta 2023-07-18 18:14:38,648 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set Group_testTableMoveTruncateAndDrop to state=DISABLING 2023-07-18 18:14:38,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, UNASSIGN}, {pid=49, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, UNASSIGN}, {pid=50, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, UNASSIGN}, {pid=51, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, UNASSIGN}, {pid=52, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, UNASSIGN}] 2023-07-18 18:14:38,654 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=49, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, UNASSIGN 2023-07-18 18:14:38,654 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=48, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, UNASSIGN 2023-07-18 18:14:38,654 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=50, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, UNASSIGN 2023-07-18 18:14:38,654 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, UNASSIGN 2023-07-18 18:14:38,655 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=47, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, UNASSIGN 2023-07-18 18:14:38,655 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=49 updating hbase:meta row=c48c7ce5ce2f72998b458ab16caad8db, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:38,655 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=48 updating hbase:meta row=e64188b531d7d823e8cb0f2ff388ee87, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:38,655 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704078655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704078655"}]},"ts":"1689704078655"} 2023-07-18 18:14:38,655 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704078655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704078655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704078655"}]},"ts":"1689704078655"} 2023-07-18 18:14:38,656 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=50 updating hbase:meta row=fb2dc29be66c8f7b880ddec041515019, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:38,656 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=bb2b45ee64be88ff38963467ba16c2aa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:38,656 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704078656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704078656"}]},"ts":"1689704078656"} 2023-07-18 18:14:38,656 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704078656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704078656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704078656"}]},"ts":"1689704078656"} 2023-07-18 18:14:38,656 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=11deb0c26551d5972e7a7e6192463f73, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:38,656 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704078656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704078656"}]},"ts":"1689704078656"} 2023-07-18 18:14:38,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=49, state=RUNNABLE; CloseRegionProcedure c48c7ce5ce2f72998b458ab16caad8db, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:38,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=48, state=RUNNABLE; CloseRegionProcedure e64188b531d7d823e8cb0f2ff388ee87, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:38,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=50, state=RUNNABLE; CloseRegionProcedure fb2dc29be66c8f7b880ddec041515019, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:38,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=52, state=RUNNABLE; CloseRegionProcedure bb2b45ee64be88ff38963467ba16c2aa, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:38,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=51, state=RUNNABLE; CloseRegionProcedure 11deb0c26551d5972e7a7e6192463f73, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:38,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=47 2023-07-18 18:14:38,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e64188b531d7d823e8cb0f2ff388ee87, disabling compactions & flushes 2023-07-18 18:14:38,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:38,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:38,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. after waiting 0 ms 2023-07-18 18:14:38,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:38,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb2b45ee64be88ff38963467ba16c2aa, disabling compactions & flushes 2023-07-18 18:14:38,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:38,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:38,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. after waiting 0 ms 2023-07-18 18:14:38,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:38,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:38,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:38,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87. 2023-07-18 18:14:38,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e64188b531d7d823e8cb0f2ff388ee87: 2023-07-18 18:14:38,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa. 2023-07-18 18:14:38,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb2b45ee64be88ff38963467ba16c2aa: 2023-07-18 18:14:38,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb2dc29be66c8f7b880ddec041515019, disabling compactions & flushes 2023-07-18 18:14:38,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:38,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:38,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. after waiting 0 ms 2023-07-18 18:14:38,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:38,840 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=48 updating hbase:meta row=e64188b531d7d823e8cb0f2ff388ee87, regionState=CLOSED 2023-07-18 18:14:38,840 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704078839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704078839"}]},"ts":"1689704078839"} 2023-07-18 18:14:38,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=bb2b45ee64be88ff38963467ba16c2aa, regionState=CLOSED 2023-07-18 18:14:38,842 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704078842"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704078842"}]},"ts":"1689704078842"} 2023-07-18 18:14:38,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:38,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019. 2023-07-18 18:14:38,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb2dc29be66c8f7b880ddec041515019: 2023-07-18 18:14:38,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=48 2023-07-18 18:14:38,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=48, state=SUCCESS; CloseRegionProcedure e64188b531d7d823e8cb0f2ff388ee87, server=jenkins-hbase4.apache.org,43237,1689704069417 in 184 msec 2023-07-18 18:14:38,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=52 2023-07-18 18:14:38,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=52, state=SUCCESS; CloseRegionProcedure bb2b45ee64be88ff38963467ba16c2aa, server=jenkins-hbase4.apache.org,36811,1689704069850 in 182 msec 2023-07-18 18:14:38,849 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=50 updating hbase:meta row=fb2dc29be66c8f7b880ddec041515019, regionState=CLOSED 2023-07-18 18:14:38,849 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078849"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704078849"}]},"ts":"1689704078849"} 2023-07-18 18:14:38,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 11deb0c26551d5972e7a7e6192463f73, disabling compactions & flushes 2023-07-18 18:14:38,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:38,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:38,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. after waiting 0 ms 2023-07-18 18:14:38,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:38,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=47, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=e64188b531d7d823e8cb0f2ff388ee87, UNASSIGN in 198 msec 2023-07-18 18:14:38,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=47, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=bb2b45ee64be88ff38963467ba16c2aa, UNASSIGN in 196 msec 2023-07-18 18:14:38,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=50 2023-07-18 18:14:38,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=50, state=SUCCESS; CloseRegionProcedure fb2dc29be66c8f7b880ddec041515019, server=jenkins-hbase4.apache.org,43237,1689704069417 in 193 msec 2023-07-18 18:14:38,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=47, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fb2dc29be66c8f7b880ddec041515019, UNASSIGN in 208 msec 2023-07-18 18:14:38,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:38,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73. 2023-07-18 18:14:38,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 11deb0c26551d5972e7a7e6192463f73: 2023-07-18 18:14:38,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c48c7ce5ce2f72998b458ab16caad8db, disabling compactions & flushes 2023-07-18 18:14:38,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:38,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:38,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. after waiting 0 ms 2023-07-18 18:14:38,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:38,865 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=11deb0c26551d5972e7a7e6192463f73, regionState=CLOSED 2023-07-18 18:14:38,865 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078865"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704078865"}]},"ts":"1689704078865"} 2023-07-18 18:14:38,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:38,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=51 2023-07-18 18:14:38,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=51, state=SUCCESS; CloseRegionProcedure 11deb0c26551d5972e7a7e6192463f73, server=jenkins-hbase4.apache.org,43237,1689704069417 in 204 msec 2023-07-18 18:14:38,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db. 2023-07-18 18:14:38,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c48c7ce5ce2f72998b458ab16caad8db: 2023-07-18 18:14:38,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=47, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=11deb0c26551d5972e7a7e6192463f73, UNASSIGN in 221 msec 2023-07-18 18:14:38,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,874 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=49 updating hbase:meta row=c48c7ce5ce2f72998b458ab16caad8db, regionState=CLOSED 2023-07-18 18:14:38,874 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704078874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704078874"}]},"ts":"1689704078874"} 2023-07-18 18:14:38,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=49 2023-07-18 18:14:38,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=49, state=SUCCESS; CloseRegionProcedure c48c7ce5ce2f72998b458ab16caad8db, server=jenkins-hbase4.apache.org,43237,1689704069417 in 218 msec 2023-07-18 18:14:38,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=47 2023-07-18 18:14:38,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=47, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=c48c7ce5ce2f72998b458ab16caad8db, UNASSIGN in 229 msec 2023-07-18 18:14:38,886 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704078886"}]},"ts":"1689704078886"} 2023-07-18 18:14:38,895 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=Group_testTableMoveTruncateAndDrop, state=DISABLED in hbase:meta 2023-07-18 18:14:38,898 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set Group_testTableMoveTruncateAndDrop to state=DISABLED 2023-07-18 18:14:38,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; DisableTableProcedure table=Group_testTableMoveTruncateAndDrop in 264 msec 2023-07-18 18:14:38,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=47 2023-07-18 18:14:38,949 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:Group_testTableMoveTruncateAndDrop, procId: 47 completed 2023-07-18 18:14:38,950 INFO [Listener at localhost/35951] client.HBaseAdmin$13(770): Started truncating Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:38,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$6(2260): Client=jenkins//172.31.14.131 truncate Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:38,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE:TRUNCATE_TABLE_PRE_OPERATION; TruncateTableProcedure (table=Group_testTableMoveTruncateAndDrop preserveSplits=true) 2023-07-18 18:14:38,970 DEBUG [PEWorker-5] procedure.TruncateTableProcedure(87): waiting for 'Group_testTableMoveTruncateAndDrop' regions in transition 2023-07-18 18:14:38,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=58 2023-07-18 18:14:38,990 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:38,990 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:38,990 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:38,990 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:38,991 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:38,995 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/recovered.edits] 2023-07-18 18:14:38,995 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/recovered.edits] 2023-07-18 18:14:38,995 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/recovered.edits] 2023-07-18 18:14:38,996 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/recovered.edits] 2023-07-18 18:14:39,000 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/recovered.edits] 2023-07-18 18:14:39,012 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/recovered.edits/7.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db/recovered.edits/7.seqid 2023-07-18 18:14:39,014 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/c48c7ce5ce2f72998b458ab16caad8db 2023-07-18 18:14:39,014 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/recovered.edits/7.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa/recovered.edits/7.seqid 2023-07-18 18:14:39,015 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/recovered.edits/7.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019/recovered.edits/7.seqid 2023-07-18 18:14:39,015 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/bb2b45ee64be88ff38963467ba16c2aa 2023-07-18 18:14:39,016 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/recovered.edits/7.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87/recovered.edits/7.seqid 2023-07-18 18:14:39,016 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fb2dc29be66c8f7b880ddec041515019 2023-07-18 18:14:39,017 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/e64188b531d7d823e8cb0f2ff388ee87 2023-07-18 18:14:39,017 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/recovered.edits/7.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73/recovered.edits/7.seqid 2023-07-18 18:14:39,018 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/11deb0c26551d5972e7a7e6192463f73 2023-07-18 18:14:39,018 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived Group_testTableMoveTruncateAndDrop regions 2023-07-18 18:14:39,063 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 5 rows of Group_testTableMoveTruncateAndDrop from hbase:meta 2023-07-18 18:14:39,070 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'Group_testTableMoveTruncateAndDrop' descriptor. 2023-07-18 18:14:39,071 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'Group_testTableMoveTruncateAndDrop' from region states. 2023-07-18 18:14:39,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704079071"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:39,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704079071"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:39,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704079071"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:39,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704079071"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:39,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704079071"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:39,077 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 5 regions from META 2023-07-18 18:14:39,077 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e64188b531d7d823e8cb0f2ff388ee87, NAME => 'Group_testTableMoveTruncateAndDrop,,1689704076267.e64188b531d7d823e8cb0f2ff388ee87.', STARTKEY => '', ENDKEY => 'aaaaa'}, {ENCODED => c48c7ce5ce2f72998b458ab16caad8db, NAME => 'Group_testTableMoveTruncateAndDrop,aaaaa,1689704076267.c48c7ce5ce2f72998b458ab16caad8db.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'}, {ENCODED => fb2dc29be66c8f7b880ddec041515019, NAME => 'Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704076267.fb2dc29be66c8f7b880ddec041515019.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'}, {ENCODED => 11deb0c26551d5972e7a7e6192463f73, NAME => 'Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704076267.11deb0c26551d5972e7a7e6192463f73.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'}, {ENCODED => bb2b45ee64be88ff38963467ba16c2aa, NAME => 'Group_testTableMoveTruncateAndDrop,zzzzz,1689704076267.bb2b45ee64be88ff38963467ba16c2aa.', STARTKEY => 'zzzzz', ENDKEY => ''}] 2023-07-18 18:14:39,077 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'Group_testTableMoveTruncateAndDrop' as deleted. 2023-07-18 18:14:39,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689704079078"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:39,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=58 2023-07-18 18:14:39,083 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table Group_testTableMoveTruncateAndDrop state from META 2023-07-18 18:14:39,092 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:39,092 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:39,093 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:39,093 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,093 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,093 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64 empty. 2023-07-18 18:14:39,093 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d empty. 2023-07-18 18:14:39,094 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84 empty. 2023-07-18 18:14:39,094 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88 empty. 2023-07-18 18:14:39,095 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,095 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083 empty. 2023-07-18 18:14:39,096 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:39,096 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,096 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:39,096 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:39,096 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived Group_testTableMoveTruncateAndDrop regions 2023-07-18 18:14:39,140 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:39,143 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(7675): creating {ENCODED => 63834a4fb8981cee0de478f4454abe88, NAME => 'Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:39,144 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(7675): creating {ENCODED => 13b81c8044e7c747562c67baab121b64, NAME => 'Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.', STARTKEY => '', ENDKEY => 'aaaaa'}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:39,144 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(7675): creating {ENCODED => f176e36d01e70077a45cbd3538061083, NAME => 'Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:39,201 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,201 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1604): Closing 13b81c8044e7c747562c67baab121b64, disabling compactions & flushes 2023-07-18 18:14:39,201 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:39,201 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:39,201 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. after waiting 0 ms 2023-07-18 18:14:39,201 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:39,201 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:39,202 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1558): Region close journal for 13b81c8044e7c747562c67baab121b64: 2023-07-18 18:14:39,202 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(7675): creating {ENCODED => fda53b285ca5948dd2784fc0df226c84, NAME => 'Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:39,216 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,216 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1604): Closing 63834a4fb8981cee0de478f4454abe88, disabling compactions & flushes 2023-07-18 18:14:39,216 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:39,217 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:39,217 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. after waiting 0 ms 2023-07-18 18:14:39,217 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:39,217 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:39,217 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1558): Region close journal for 63834a4fb8981cee0de478f4454abe88: 2023-07-18 18:14:39,217 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(7675): creating {ENCODED => b2e71025f5d9623c20f41f93cdb8eb6d, NAME => 'Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.', STARTKEY => 'zzzzz', ENDKEY => ''}, tableDescriptor='Group_testTableMoveTruncateAndDrop', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:39,266 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,266 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1604): Closing fda53b285ca5948dd2784fc0df226c84, disabling compactions & flushes 2023-07-18 18:14:39,266 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:39,266 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:39,266 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. after waiting 0 ms 2023-07-18 18:14:39,266 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:39,266 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:39,266 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-0] regionserver.HRegion(1558): Region close journal for fda53b285ca5948dd2784fc0df226c84: 2023-07-18 18:14:39,271 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,272 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1604): Closing b2e71025f5d9623c20f41f93cdb8eb6d, disabling compactions & flushes 2023-07-18 18:14:39,272 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:39,272 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:39,272 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. after waiting 0 ms 2023-07-18 18:14:39,272 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:39,272 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:39,272 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-2] regionserver.HRegion(1558): Region close journal for b2e71025f5d9623c20f41f93cdb8eb6d: 2023-07-18 18:14:39,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=58 2023-07-18 18:14:39,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=58 2023-07-18 18:14:39,594 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,594 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1604): Closing f176e36d01e70077a45cbd3538061083, disabling compactions & flushes 2023-07-18 18:14:39,594 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:39,594 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:39,594 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. after waiting 0 ms 2023-07-18 18:14:39,594 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:39,594 INFO [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:39,594 DEBUG [RegionOpenAndInit-Group_testTableMoveTruncateAndDrop-pool-1] regionserver.HRegion(1558): Region close journal for f176e36d01e70077a45cbd3538061083: 2023-07-18 18:14:39,600 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704079600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704079600"}]},"ts":"1689704079600"} 2023-07-18 18:14:39,600 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704079600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704079600"}]},"ts":"1689704079600"} 2023-07-18 18:14:39,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704079600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704079600"}]},"ts":"1689704079600"} 2023-07-18 18:14:39,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704079600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704079600"}]},"ts":"1689704079600"} 2023-07-18 18:14:39,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704079600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704079600"}]},"ts":"1689704079600"} 2023-07-18 18:14:39,604 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 5 regions to meta. 2023-07-18 18:14:39,607 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704079607"}]},"ts":"1689704079607"} 2023-07-18 18:14:39,609 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=Group_testTableMoveTruncateAndDrop, state=ENABLING in hbase:meta 2023-07-18 18:14:39,614 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:39,615 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:39,615 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:39,615 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:39,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=59, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=13b81c8044e7c747562c67baab121b64, ASSIGN}, {pid=60, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=f176e36d01e70077a45cbd3538061083, ASSIGN}, {pid=61, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=63834a4fb8981cee0de478f4454abe88, ASSIGN}, {pid=62, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fda53b285ca5948dd2784fc0df226c84, ASSIGN}, {pid=63, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=b2e71025f5d9623c20f41f93cdb8eb6d, ASSIGN}] 2023-07-18 18:14:39,620 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=60, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=f176e36d01e70077a45cbd3538061083, ASSIGN 2023-07-18 18:14:39,620 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=13b81c8044e7c747562c67baab121b64, ASSIGN 2023-07-18 18:14:39,621 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=63834a4fb8981cee0de478f4454abe88, ASSIGN 2023-07-18 18:14:39,621 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=62, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fda53b285ca5948dd2784fc0df226c84, ASSIGN 2023-07-18 18:14:39,621 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=63, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=b2e71025f5d9623c20f41f93cdb8eb6d, ASSIGN 2023-07-18 18:14:39,622 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=60, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=f176e36d01e70077a45cbd3538061083, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36811,1689704069850; forceNewPlan=false, retain=false 2023-07-18 18:14:39,622 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=63834a4fb8981cee0de478f4454abe88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:39,622 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=13b81c8044e7c747562c67baab121b64, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36811,1689704069850; forceNewPlan=false, retain=false 2023-07-18 18:14:39,623 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=62, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fda53b285ca5948dd2784fc0df226c84, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36811,1689704069850; forceNewPlan=false, retain=false 2023-07-18 18:14:39,623 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=63, ppid=58, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=b2e71025f5d9623c20f41f93cdb8eb6d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:39,772 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 5 regions. 5 retained the pre-restart assignment. 2023-07-18 18:14:39,776 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=63 updating hbase:meta row=b2e71025f5d9623c20f41f93cdb8eb6d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:39,777 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704079776"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704079776"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704079776"}]},"ts":"1689704079776"} 2023-07-18 18:14:39,777 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=63834a4fb8981cee0de478f4454abe88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:39,777 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=60 updating hbase:meta row=f176e36d01e70077a45cbd3538061083, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:39,777 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704079777"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704079777"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704079777"}]},"ts":"1689704079777"} 2023-07-18 18:14:39,777 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704079777"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704079777"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704079777"}]},"ts":"1689704079777"} 2023-07-18 18:14:39,777 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=62 updating hbase:meta row=fda53b285ca5948dd2784fc0df226c84, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:39,778 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704079777"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704079777"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704079777"}]},"ts":"1689704079777"} 2023-07-18 18:14:39,778 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=13b81c8044e7c747562c67baab121b64, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:39,778 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704079778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704079778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704079778"}]},"ts":"1689704079778"} 2023-07-18 18:14:39,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE; OpenRegionProcedure b2e71025f5d9623c20f41f93cdb8eb6d, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:39,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=61, state=RUNNABLE; OpenRegionProcedure 63834a4fb8981cee0de478f4454abe88, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:39,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=60, state=RUNNABLE; OpenRegionProcedure f176e36d01e70077a45cbd3538061083, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:39,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=62, state=RUNNABLE; OpenRegionProcedure fda53b285ca5948dd2784fc0df226c84, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:39,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=59, state=RUNNABLE; OpenRegionProcedure 13b81c8044e7c747562c67baab121b64, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:39,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:39,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fda53b285ca5948dd2784fc0df226c84, NAME => 'Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'} 2023-07-18 18:14:39,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,959 INFO [StoreOpener-fda53b285ca5948dd2784fc0df226c84-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,963 DEBUG [StoreOpener-fda53b285ca5948dd2784fc0df226c84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84/f 2023-07-18 18:14:39,963 DEBUG [StoreOpener-fda53b285ca5948dd2784fc0df226c84-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84/f 2023-07-18 18:14:39,963 INFO [StoreOpener-fda53b285ca5948dd2784fc0df226c84-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fda53b285ca5948dd2784fc0df226c84 columnFamilyName f 2023-07-18 18:14:39,964 INFO [StoreOpener-fda53b285ca5948dd2784fc0df226c84-1] regionserver.HStore(310): Store=fda53b285ca5948dd2784fc0df226c84/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:39,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:39,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b2e71025f5d9623c20f41f93cdb8eb6d, NAME => 'Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.', STARTKEY => 'zzzzz', ENDKEY => ''} 2023-07-18 18:14:39,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,970 INFO [StoreOpener-b2e71025f5d9623c20f41f93cdb8eb6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:39,973 DEBUG [StoreOpener-b2e71025f5d9623c20f41f93cdb8eb6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d/f 2023-07-18 18:14:39,973 DEBUG [StoreOpener-b2e71025f5d9623c20f41f93cdb8eb6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d/f 2023-07-18 18:14:39,973 INFO [StoreOpener-b2e71025f5d9623c20f41f93cdb8eb6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2e71025f5d9623c20f41f93cdb8eb6d columnFamilyName f 2023-07-18 18:14:39,974 INFO [StoreOpener-b2e71025f5d9623c20f41f93cdb8eb6d-1] regionserver.HStore(310): Store=b2e71025f5d9623c20f41f93cdb8eb6d/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:39,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:39,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fda53b285ca5948dd2784fc0df226c84; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9721667520, jitterRate=-0.0945991575717926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:39,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fda53b285ca5948dd2784fc0df226c84: 2023-07-18 18:14:39,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84., pid=67, masterSystemTime=1689704079940 2023-07-18 18:14:39,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:39,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:39,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:39,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 13b81c8044e7c747562c67baab121b64, NAME => 'Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.', STARTKEY => '', ENDKEY => 'aaaaa'} 2023-07-18 18:14:39,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop 13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:39,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:39,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:39,981 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=62 updating hbase:meta row=fda53b285ca5948dd2784fc0df226c84, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:39,982 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704079981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704079981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704079981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704079981"}]},"ts":"1689704079981"} 2023-07-18 18:14:39,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:39,987 INFO [StoreOpener-13b81c8044e7c747562c67baab121b64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:39,989 DEBUG [StoreOpener-13b81c8044e7c747562c67baab121b64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64/f 2023-07-18 18:14:39,989 DEBUG [StoreOpener-13b81c8044e7c747562c67baab121b64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64/f 2023-07-18 18:14:39,991 INFO [StoreOpener-13b81c8044e7c747562c67baab121b64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13b81c8044e7c747562c67baab121b64 columnFamilyName f 2023-07-18 18:14:39,992 INFO [StoreOpener-13b81c8044e7c747562c67baab121b64-1] regionserver.HStore(310): Store=13b81c8044e7c747562c67baab121b64/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:39,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:39,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b2e71025f5d9623c20f41f93cdb8eb6d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9450828640, jitterRate=-0.11982299387454987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:39,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b2e71025f5d9623c20f41f93cdb8eb6d: 2023-07-18 18:14:39,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=62 2023-07-18 18:14:39,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=62, state=SUCCESS; OpenRegionProcedure fda53b285ca5948dd2784fc0df226c84, server=jenkins-hbase4.apache.org,36811,1689704069850 in 203 msec 2023-07-18 18:14:39,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:39,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d., pid=64, masterSystemTime=1689704079939 2023-07-18 18:14:39,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:39,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=58, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fda53b285ca5948dd2784fc0df226c84, ASSIGN in 379 msec 2023-07-18 18:14:39,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:39,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:39,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63834a4fb8981cee0de478f4454abe88, NAME => 'Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'} 2023-07-18 18:14:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop 63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:39,998 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=63 updating hbase:meta row=b2e71025f5d9623c20f41f93cdb8eb6d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:39,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:39,998 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704079998"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704079998"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704079998"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704079998"}]},"ts":"1689704079998"} 2023-07-18 18:14:40,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:40,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-18 18:14:40,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; OpenRegionProcedure b2e71025f5d9623c20f41f93cdb8eb6d, server=jenkins-hbase4.apache.org,43237,1689704069417 in 217 msec 2023-07-18 18:14:40,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=58, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=b2e71025f5d9623c20f41f93cdb8eb6d, ASSIGN in 388 msec 2023-07-18 18:14:40,005 INFO [StoreOpener-63834a4fb8981cee0de478f4454abe88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:40,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:40,010 DEBUG [StoreOpener-63834a4fb8981cee0de478f4454abe88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88/f 2023-07-18 18:14:40,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 13b81c8044e7c747562c67baab121b64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11031877600, jitterRate=0.027423664927482605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:40,010 DEBUG [StoreOpener-63834a4fb8981cee0de478f4454abe88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88/f 2023-07-18 18:14:40,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 13b81c8044e7c747562c67baab121b64: 2023-07-18 18:14:40,011 INFO [StoreOpener-63834a4fb8981cee0de478f4454abe88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63834a4fb8981cee0de478f4454abe88 columnFamilyName f 2023-07-18 18:14:40,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64., pid=68, masterSystemTime=1689704079940 2023-07-18 18:14:40,012 INFO [StoreOpener-63834a4fb8981cee0de478f4454abe88-1] regionserver.HStore(310): Store=63834a4fb8981cee0de478f4454abe88/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:40,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:40,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:40,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:40,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:40,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:40,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f176e36d01e70077a45cbd3538061083, NAME => 'Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'} 2023-07-18 18:14:40,014 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=13b81c8044e7c747562c67baab121b64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:40,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testTableMoveTruncateAndDrop f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:40,014 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704080014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704080014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704080014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704080014"}]},"ts":"1689704080014"} 2023-07-18 18:14:40,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=59 2023-07-18 18:14:40,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=59, state=SUCCESS; OpenRegionProcedure 13b81c8044e7c747562c67baab121b64, server=jenkins-hbase4.apache.org,36811,1689704069850 in 228 msec 2023-07-18 18:14:40,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=58, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=13b81c8044e7c747562c67baab121b64, ASSIGN in 404 msec 2023-07-18 18:14:40,022 INFO [StoreOpener-f176e36d01e70077a45cbd3538061083-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,024 DEBUG [StoreOpener-f176e36d01e70077a45cbd3538061083-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083/f 2023-07-18 18:14:40,025 DEBUG [StoreOpener-f176e36d01e70077a45cbd3538061083-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083/f 2023-07-18 18:14:40,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:40,026 INFO [StoreOpener-f176e36d01e70077a45cbd3538061083-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f176e36d01e70077a45cbd3538061083 columnFamilyName f 2023-07-18 18:14:40,026 INFO [StoreOpener-f176e36d01e70077a45cbd3538061083-1] regionserver.HStore(310): Store=f176e36d01e70077a45cbd3538061083/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:40,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:40,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 63834a4fb8981cee0de478f4454abe88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11106334720, jitterRate=0.03435802459716797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:40,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 63834a4fb8981cee0de478f4454abe88: 2023-07-18 18:14:40,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88., pid=65, masterSystemTime=1689704079939 2023-07-18 18:14:40,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:40,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:40,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,033 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=63834a4fb8981cee0de478f4454abe88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:40,033 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704080032"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704080032"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704080032"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704080032"}]},"ts":"1689704080032"} 2023-07-18 18:14:40,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:40,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f176e36d01e70077a45cbd3538061083; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10107188320, jitterRate=-0.058694735169410706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:40,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f176e36d01e70077a45cbd3538061083: 2023-07-18 18:14:40,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083., pid=66, masterSystemTime=1689704079940 2023-07-18 18:14:40,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=61 2023-07-18 18:14:40,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=61, state=SUCCESS; OpenRegionProcedure 63834a4fb8981cee0de478f4454abe88, server=jenkins-hbase4.apache.org,43237,1689704069417 in 251 msec 2023-07-18 18:14:40,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:40,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:40,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=63834a4fb8981cee0de478f4454abe88, ASSIGN in 422 msec 2023-07-18 18:14:40,040 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=60 updating hbase:meta row=f176e36d01e70077a45cbd3538061083, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:40,040 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704080040"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704080040"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704080040"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704080040"}]},"ts":"1689704080040"} 2023-07-18 18:14:40,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=60 2023-07-18 18:14:40,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=60, state=SUCCESS; OpenRegionProcedure f176e36d01e70077a45cbd3538061083, server=jenkins-hbase4.apache.org,36811,1689704069850 in 258 msec 2023-07-18 18:14:40,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-18 18:14:40,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=f176e36d01e70077a45cbd3538061083, ASSIGN in 430 msec 2023-07-18 18:14:40,048 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704080047"}]},"ts":"1689704080047"} 2023-07-18 18:14:40,049 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=Group_testTableMoveTruncateAndDrop, state=ENABLED in hbase:meta 2023-07-18 18:14:40,054 DEBUG [PEWorker-5] procedure.TruncateTableProcedure(145): truncate 'Group_testTableMoveTruncateAndDrop' completed 2023-07-18 18:14:40,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; TruncateTableProcedure (table=Group_testTableMoveTruncateAndDrop preserveSplits=true) in 1.0950 sec 2023-07-18 18:14:40,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=58 2023-07-18 18:14:40,088 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: TRUNCATE, Table Name: default:Group_testTableMoveTruncateAndDrop, procId: 58 completed 2023-07-18 18:14:40,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:40,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:40,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:40,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:40,092 INFO [Listener at localhost/35951] client.HBaseAdmin$15(890): Started disable of Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=69, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=69 2023-07-18 18:14:40,098 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704080097"}]},"ts":"1689704080097"} 2023-07-18 18:14:40,099 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=Group_testTableMoveTruncateAndDrop, state=DISABLING in hbase:meta 2023-07-18 18:14:40,101 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set Group_testTableMoveTruncateAndDrop to state=DISABLING 2023-07-18 18:14:40,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=13b81c8044e7c747562c67baab121b64, UNASSIGN}, {pid=71, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=f176e36d01e70077a45cbd3538061083, UNASSIGN}, {pid=72, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=63834a4fb8981cee0de478f4454abe88, UNASSIGN}, {pid=73, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fda53b285ca5948dd2784fc0df226c84, UNASSIGN}, {pid=74, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=b2e71025f5d9623c20f41f93cdb8eb6d, UNASSIGN}] 2023-07-18 18:14:40,104 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=70, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=13b81c8044e7c747562c67baab121b64, UNASSIGN 2023-07-18 18:14:40,104 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=f176e36d01e70077a45cbd3538061083, UNASSIGN 2023-07-18 18:14:40,105 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=63834a4fb8981cee0de478f4454abe88, UNASSIGN 2023-07-18 18:14:40,105 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=74, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=b2e71025f5d9623c20f41f93cdb8eb6d, UNASSIGN 2023-07-18 18:14:40,105 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=69, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fda53b285ca5948dd2784fc0df226c84, UNASSIGN 2023-07-18 18:14:40,106 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=13b81c8044e7c747562c67baab121b64, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:40,106 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=f176e36d01e70077a45cbd3538061083, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:40,106 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704080106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704080106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704080106"}]},"ts":"1689704080106"} 2023-07-18 18:14:40,106 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704080106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704080106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704080106"}]},"ts":"1689704080106"} 2023-07-18 18:14:40,106 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=b2e71025f5d9623c20f41f93cdb8eb6d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:40,106 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fda53b285ca5948dd2784fc0df226c84, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:40,106 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=63834a4fb8981cee0de478f4454abe88, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:40,106 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704080106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704080106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704080106"}]},"ts":"1689704080106"} 2023-07-18 18:14:40,106 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704080106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704080106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704080106"}]},"ts":"1689704080106"} 2023-07-18 18:14:40,106 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704080106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704080106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704080106"}]},"ts":"1689704080106"} 2023-07-18 18:14:40,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=71, state=RUNNABLE; CloseRegionProcedure f176e36d01e70077a45cbd3538061083, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:40,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=70, state=RUNNABLE; CloseRegionProcedure 13b81c8044e7c747562c67baab121b64, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:40,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=73, state=RUNNABLE; CloseRegionProcedure fda53b285ca5948dd2784fc0df226c84, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:40,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=78, ppid=74, state=RUNNABLE; CloseRegionProcedure b2e71025f5d9623c20f41f93cdb8eb6d, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:40,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=79, ppid=72, state=RUNNABLE; CloseRegionProcedure 63834a4fb8981cee0de478f4454abe88, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:40,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=69 2023-07-18 18:14:40,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f176e36d01e70077a45cbd3538061083, disabling compactions & flushes 2023-07-18 18:14:40,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:40,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:40,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. after waiting 0 ms 2023-07-18 18:14:40,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:40,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:40,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 63834a4fb8981cee0de478f4454abe88, disabling compactions & flushes 2023-07-18 18:14:40,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:40,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:40,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. after waiting 0 ms 2023-07-18 18:14:40,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:40,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:40,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:40,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88. 2023-07-18 18:14:40,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083. 2023-07-18 18:14:40,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f176e36d01e70077a45cbd3538061083: 2023-07-18 18:14:40,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 63834a4fb8981cee0de478f4454abe88: 2023-07-18 18:14:40,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:40,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 13b81c8044e7c747562c67baab121b64, disabling compactions & flushes 2023-07-18 18:14:40,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:40,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:40,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. after waiting 0 ms 2023-07-18 18:14:40,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:40,279 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=71 updating hbase:meta row=f176e36d01e70077a45cbd3538061083, regionState=CLOSED 2023-07-18 18:14:40,279 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704080279"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704080279"}]},"ts":"1689704080279"} 2023-07-18 18:14:40,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:40,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:40,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b2e71025f5d9623c20f41f93cdb8eb6d, disabling compactions & flushes 2023-07-18 18:14:40,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:40,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:40,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. after waiting 0 ms 2023-07-18 18:14:40,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:40,280 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=63834a4fb8981cee0de478f4454abe88, regionState=CLOSED 2023-07-18 18:14:40,281 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704080280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704080280"}]},"ts":"1689704080280"} 2023-07-18 18:14:40,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:40,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d. 2023-07-18 18:14:40,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b2e71025f5d9623c20f41f93cdb8eb6d: 2023-07-18 18:14:40,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:40,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=71 2023-07-18 18:14:40,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=71, state=SUCCESS; CloseRegionProcedure f176e36d01e70077a45cbd3538061083, server=jenkins-hbase4.apache.org,36811,1689704069850 in 175 msec 2023-07-18 18:14:40,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64. 2023-07-18 18:14:40,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 13b81c8044e7c747562c67baab121b64: 2023-07-18 18:14:40,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=79, resume processing ppid=72 2023-07-18 18:14:40,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, ppid=72, state=SUCCESS; CloseRegionProcedure 63834a4fb8981cee0de478f4454abe88, server=jenkins-hbase4.apache.org,43237,1689704069417 in 171 msec 2023-07-18 18:14:40,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:40,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, ppid=69, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=f176e36d01e70077a45cbd3538061083, UNASSIGN in 186 msec 2023-07-18 18:14:40,295 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=b2e71025f5d9623c20f41f93cdb8eb6d, regionState=CLOSED 2023-07-18 18:14:40,295 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704080295"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704080295"}]},"ts":"1689704080295"} 2023-07-18 18:14:40,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:40,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:40,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fda53b285ca5948dd2784fc0df226c84, disabling compactions & flushes 2023-07-18 18:14:40,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:40,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:40,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. after waiting 0 ms 2023-07-18 18:14:40,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:40,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=69, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=63834a4fb8981cee0de478f4454abe88, UNASSIGN in 192 msec 2023-07-18 18:14:40,298 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=13b81c8044e7c747562c67baab121b64, regionState=CLOSED 2023-07-18 18:14:40,298 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.","families":{"info":[{"qualifier":"regioninfo","vlen":73,"tag":[],"timestamp":"1689704080298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704080298"}]},"ts":"1689704080298"} 2023-07-18 18:14:40,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:40,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84. 2023-07-18 18:14:40,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fda53b285ca5948dd2784fc0df226c84: 2023-07-18 18:14:40,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:40,307 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fda53b285ca5948dd2784fc0df226c84, regionState=CLOSED 2023-07-18 18:14:40,307 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689704080307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704080307"}]},"ts":"1689704080307"} 2023-07-18 18:14:40,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=78, resume processing ppid=74 2023-07-18 18:14:40,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, ppid=74, state=SUCCESS; CloseRegionProcedure b2e71025f5d9623c20f41f93cdb8eb6d, server=jenkins-hbase4.apache.org,43237,1689704069417 in 193 msec 2023-07-18 18:14:40,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=70 2023-07-18 18:14:40,309 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=70, state=SUCCESS; CloseRegionProcedure 13b81c8044e7c747562c67baab121b64, server=jenkins-hbase4.apache.org,36811,1689704069850 in 196 msec 2023-07-18 18:14:40,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=69, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=b2e71025f5d9623c20f41f93cdb8eb6d, UNASSIGN in 206 msec 2023-07-18 18:14:40,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=69, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=13b81c8044e7c747562c67baab121b64, UNASSIGN in 208 msec 2023-07-18 18:14:40,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=73 2023-07-18 18:14:40,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=73, state=SUCCESS; CloseRegionProcedure fda53b285ca5948dd2784fc0df226c84, server=jenkins-hbase4.apache.org,36811,1689704069850 in 202 msec 2023-07-18 18:14:40,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=69 2023-07-18 18:14:40,316 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=69, state=SUCCESS; TransitRegionStateProcedure table=Group_testTableMoveTruncateAndDrop, region=fda53b285ca5948dd2784fc0df226c84, UNASSIGN in 212 msec 2023-07-18 18:14:40,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704080317"}]},"ts":"1689704080317"} 2023-07-18 18:14:40,319 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=Group_testTableMoveTruncateAndDrop, state=DISABLED in hbase:meta 2023-07-18 18:14:40,321 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set Group_testTableMoveTruncateAndDrop to state=DISABLED 2023-07-18 18:14:40,323 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, state=SUCCESS; DisableTableProcedure table=Group_testTableMoveTruncateAndDrop in 228 msec 2023-07-18 18:14:40,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=69 2023-07-18 18:14:40,401 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:Group_testTableMoveTruncateAndDrop, procId: 69 completed 2023-07-18 18:14:40,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,415 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=80, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint(577): Removing deleted table 'Group_testTableMoveTruncateAndDrop' from rsgroup 'Group_testTableMoveTruncateAndDrop_1994555507' 2023-07-18 18:14:40,416 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=80, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:40,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:40,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 18:14:40,430 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:40,430 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,430 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:40,430 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:40,430 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:40,433 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88/recovered.edits] 2023-07-18 18:14:40,433 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64/recovered.edits] 2023-07-18 18:14:40,433 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84/recovered.edits] 2023-07-18 18:14:40,434 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083/recovered.edits] 2023-07-18 18:14:40,434 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d/recovered.edits] 2023-07-18 18:14:40,441 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64/recovered.edits/4.seqid 2023-07-18 18:14:40,442 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/13b81c8044e7c747562c67baab121b64 2023-07-18 18:14:40,456 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88/recovered.edits/4.seqid 2023-07-18 18:14:40,457 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84/recovered.edits/4.seqid 2023-07-18 18:14:40,457 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083/recovered.edits/4.seqid 2023-07-18 18:14:40,457 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/63834a4fb8981cee0de478f4454abe88 2023-07-18 18:14:40,458 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/fda53b285ca5948dd2784fc0df226c84 2023-07-18 18:14:40,458 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/f176e36d01e70077a45cbd3538061083 2023-07-18 18:14:40,458 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d/recovered.edits/4.seqid 2023-07-18 18:14:40,459 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testTableMoveTruncateAndDrop/b2e71025f5d9623c20f41f93cdb8eb6d 2023-07-18 18:14:40,459 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived Group_testTableMoveTruncateAndDrop regions 2023-07-18 18:14:40,462 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=80, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,469 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 5 rows of Group_testTableMoveTruncateAndDrop from hbase:meta 2023-07-18 18:14:40,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'Group_testTableMoveTruncateAndDrop' descriptor. 2023-07-18 18:14:40,477 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=80, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,477 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'Group_testTableMoveTruncateAndDrop' from region states. 2023-07-18 18:14:40,477 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704080477"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:40,477 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704080477"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:40,477 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,i\\xBF\\x14i\\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704080477"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:40,477 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,r\\x1C\\xC7r\\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704080477"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:40,478 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704080477"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:40,480 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 5 regions from META 2023-07-18 18:14:40,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 13b81c8044e7c747562c67baab121b64, NAME => 'Group_testTableMoveTruncateAndDrop,,1689704079020.13b81c8044e7c747562c67baab121b64.', STARTKEY => '', ENDKEY => 'aaaaa'}, {ENCODED => f176e36d01e70077a45cbd3538061083, NAME => 'Group_testTableMoveTruncateAndDrop,aaaaa,1689704079020.f176e36d01e70077a45cbd3538061083.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'}, {ENCODED => 63834a4fb8981cee0de478f4454abe88, NAME => 'Group_testTableMoveTruncateAndDrop,i\xBF\x14i\xBE,1689704079021.63834a4fb8981cee0de478f4454abe88.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'}, {ENCODED => fda53b285ca5948dd2784fc0df226c84, NAME => 'Group_testTableMoveTruncateAndDrop,r\x1C\xC7r\x1B,1689704079021.fda53b285ca5948dd2784fc0df226c84.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'}, {ENCODED => b2e71025f5d9623c20f41f93cdb8eb6d, NAME => 'Group_testTableMoveTruncateAndDrop,zzzzz,1689704079021.b2e71025f5d9623c20f41f93cdb8eb6d.', STARTKEY => 'zzzzz', ENDKEY => ''}] 2023-07-18 18:14:40,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'Group_testTableMoveTruncateAndDrop' as deleted. 2023-07-18 18:14:40,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testTableMoveTruncateAndDrop","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689704080480"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:40,482 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table Group_testTableMoveTruncateAndDrop state from META 2023-07-18 18:14:40,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=80, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=Group_testTableMoveTruncateAndDrop 2023-07-18 18:14:40,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DeleteTableProcedure table=Group_testTableMoveTruncateAndDrop in 77 msec 2023-07-18 18:14:40,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 18:14:40,531 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:Group_testTableMoveTruncateAndDrop, procId: 80 completed 2023-07-18 18:14:40,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:40,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:40,535 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43237] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Scan size: 147 connection: 172.31.14.131:39550 deadline: 1689704140535, exception=org.apache.hadoop.hbase.exceptions.RegionMovedException: Region moved to: hostname=jenkins-hbase4.apache.org port=46845 startCode=1689704069644. As of locationSeqNum=6. 2023-07-18 18:14:40,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:40,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:40,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:40,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811] to rsgroup default 2023-07-18 18:14:40,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:40,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:40,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group Group_testTableMoveTruncateAndDrop_1994555507, current retry=0 2023-07-18 18:14:40,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417] are moved back to Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:40,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: Group_testTableMoveTruncateAndDrop_1994555507 => default 2023-07-18 18:14:40,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:40,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup Group_testTableMoveTruncateAndDrop_1994555507 2023-07-18 18:14:40,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 5 2023-07-18 18:14:40,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:40,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:40,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:40,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:40,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:40,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:40,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:40,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:40,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:40,683 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:40,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:40,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:40,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:40,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:40,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:40,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 147 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705280698, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:40,699 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:40,701 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:40,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,702 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:40,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:40,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:40,734 INFO [Listener at localhost/35951] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testTableMoveTruncateAndDrop Thread=505 (was 421) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_340288162_17 at /127.0.0.1:43274 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741843_1019] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_340288162_17 at /127.0.0.1:41404 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741840_1016] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_340288162_17 at /127.0.0.1:53772 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741843_1019] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741843_1019, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741843_1019, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_META-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_340288162_17 at /127.0.0.1:43240 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741840_1016] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=0,queue=0,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:3;jenkins-hbase4:46365-longCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1106068443-638 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600591717_17 at /127.0.0.1:41448 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_340288162_17 at /127.0.0.1:53742 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741840_1016] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1106068443-636-acceptor-0@1c443cd9-ServerConnector@1c038137{HTTP/1.1, (http/1.1)}{0.0.0.0:45859} sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.hbase.thirdparty.org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:388) org.apache.hbase.thirdparty.org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:704) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:46377 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53006@0x5fc58c1f-SendThread(127.0.0.1:53006) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1600591717_17 at /127.0.0.1:53786 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.metaPriority.FPBQ.Fifo.handler=0,queue=0,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c-prefix:jenkins-hbase4.apache.org,46365,1689704073486 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1117110726_17 at /127.0.0.1:43310 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1106068443-641 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c-prefix:jenkins-hbase4.apache.org,46365,1689704073486.meta sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp1106068443-642 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase4:46365Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53006@0x5fc58c1f-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741840_1016, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1106068443-640 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741843_1019, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:46377 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53006@0x5fc58c1f sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Session-HouseKeeper-1a482f9e-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1106068443-639 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741840_1016, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=1,queue=0,port=46365 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_340288162_17 at /127.0.0.1:41440 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741843_1019] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:3;jenkins-hbase4:46365 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:81) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:64) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1092) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:175) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:123) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:159) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:360) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1873) org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:319) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:156) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1106068443-635 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741840_1016, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1106068443-637 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x120ad869-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=819 (was 677) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=457 (was 403) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=3409 (was 3973) 2023-07-18 18:14:40,736 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=505 is superior to 500 2023-07-18 18:14:40,755 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testValidGroupNames Thread=505, OpenFileDescriptor=819, MaxFileDescriptor=60000, SystemLoadAverage=457, ProcessCount=173, AvailableMemoryMB=3408 2023-07-18 18:14:40,755 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=505 is superior to 500 2023-07-18 18:14:40,757 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testValidGroupNames 2023-07-18 18:14:40,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:40,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:40,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:40,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:40,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:40,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:40,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:40,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:40,777 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:40,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:40,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:40,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:40,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:40,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:40,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 175 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705280791, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:40,791 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:40,793 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:40,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,795 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:40,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:40,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:40,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup foo* 2023-07-18 18:14:40,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup name should only contain alphanumeric characters at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.checkGroupName(RSGroupInfoManagerImpl.java:932) at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.addRSGroup(RSGroupInfoManagerImpl.java:205) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.addRSGroup(RSGroupAdminServer.java:476) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.addRSGroup(RSGroupAdminEndpoint.java:258) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16203) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:40,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 181 service: MasterService methodName: ExecMasterService size: 83 connection: 172.31.14.131:58898 deadline: 1689705280797, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup name should only contain alphanumeric characters 2023-07-18 18:14:40,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup foo@ 2023-07-18 18:14:40,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup name should only contain alphanumeric characters at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.checkGroupName(RSGroupInfoManagerImpl.java:932) at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.addRSGroup(RSGroupInfoManagerImpl.java:205) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.addRSGroup(RSGroupAdminServer.java:476) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.addRSGroup(RSGroupAdminEndpoint.java:258) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16203) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:40,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 183 service: MasterService methodName: ExecMasterService size: 83 connection: 172.31.14.131:58898 deadline: 1689705280799, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup name should only contain alphanumeric characters 2023-07-18 18:14:40,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup - 2023-07-18 18:14:40,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup name should only contain alphanumeric characters at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.checkGroupName(RSGroupInfoManagerImpl.java:932) at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.addRSGroup(RSGroupInfoManagerImpl.java:205) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.addRSGroup(RSGroupAdminServer.java:476) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.addRSGroup(RSGroupAdminEndpoint.java:258) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16203) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:40,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 185 service: MasterService methodName: ExecMasterService size: 80 connection: 172.31.14.131:58898 deadline: 1689705280801, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup name should only contain alphanumeric characters 2023-07-18 18:14:40,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup foo_123 2023-07-18 18:14:40,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/foo_123 2023-07-18 18:14:40,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:40,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:40,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:40,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:40,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:40,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:40,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:40,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup foo_123 2023-07-18 18:14:40,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 5 2023-07-18 18:14:40,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:40,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:40,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:40,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:40,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:40,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:40,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:40,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:40,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:40,856 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:40,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:40,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:40,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:40,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:40,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:40,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 219 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705280872, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:40,873 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:40,875 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:40,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,877 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:40,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:40,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:40,897 INFO [Listener at localhost/35951] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testValidGroupNames Thread=508 (was 505) Potentially hanging thread: hconnection-0x120ad869-shared-pool-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=819 (was 819), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=457 (was 457), ProcessCount=173 (was 173), AvailableMemoryMB=3405 (was 3408) 2023-07-18 18:14:40,897 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=508 is superior to 500 2023-07-18 18:14:40,918 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testFailRemoveGroup Thread=508, OpenFileDescriptor=819, MaxFileDescriptor=60000, SystemLoadAverage=457, ProcessCount=173, AvailableMemoryMB=3404 2023-07-18 18:14:40,918 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=508 is superior to 500 2023-07-18 18:14:40,918 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testFailRemoveGroup 2023-07-18 18:14:40,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:40,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:40,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:40,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:40,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:40,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:40,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:40,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:40,936 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:40,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:40,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:40,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:40,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:40,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:40,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 247 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705280948, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:40,949 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:40,951 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:40,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,952 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:40,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:40,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:40,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:40,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:40,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup bar 2023-07-18 18:14:40,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/bar 2023-07-18 18:14:40,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:40,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:40,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:40,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:40,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:46365] to rsgroup bar 2023-07-18 18:14:40,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/bar 2023-07-18 18:14:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:40,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(238): Moving server region 1588230740, which do not belong to RSGroup bar 2023-07-18 18:14:40,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=81, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, REOPEN/MOVE 2023-07-18 18:14:40,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 1 region(s) to group default, current retry=0 2023-07-18 18:14:40,975 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, REOPEN/MOVE 2023-07-18 18:14:40,977 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46365,1689704073486, state=CLOSING 2023-07-18 18:14:40,978 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:14:40,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:40,978 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:41,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1588230740 2023-07-18 18:14:41,135 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:14:41,136 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:14:41,136 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:14:41,136 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:14:41,136 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:14:41,136 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=39.91 KB heapSize=61.45 KB 2023-07-18 18:14:41,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=37.02 KB at sequenceid=104 (bloomFilter=false), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/info/c0c72ba92a98468fb6147506a1b3ea6b 2023-07-18 18:14:41,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0c72ba92a98468fb6147506a1b3ea6b 2023-07-18 18:14:41,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.15 KB at sequenceid=104 (bloomFilter=false), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/rep_barrier/ff8182fb715f4886b429a57523a1a67b 2023-07-18 18:14:41,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff8182fb715f4886b429a57523a1a67b 2023-07-18 18:14:41,251 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.73 KB at sequenceid=104 (bloomFilter=false), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/table/c4ea76dd957140528dc0af5a91446450 2023-07-18 18:14:41,258 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ea76dd957140528dc0af5a91446450 2023-07-18 18:14:41,259 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/info/c0c72ba92a98468fb6147506a1b3ea6b as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/c0c72ba92a98468fb6147506a1b3ea6b 2023-07-18 18:14:41,267 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0c72ba92a98468fb6147506a1b3ea6b 2023-07-18 18:14:41,267 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/c0c72ba92a98468fb6147506a1b3ea6b, entries=40, sequenceid=104, filesize=9.4 K 2023-07-18 18:14:41,268 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/rep_barrier/ff8182fb715f4886b429a57523a1a67b as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier/ff8182fb715f4886b429a57523a1a67b 2023-07-18 18:14:41,276 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff8182fb715f4886b429a57523a1a67b 2023-07-18 18:14:41,276 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier/ff8182fb715f4886b429a57523a1a67b, entries=10, sequenceid=104, filesize=6.1 K 2023-07-18 18:14:41,277 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/table/c4ea76dd957140528dc0af5a91446450 as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/c4ea76dd957140528dc0af5a91446450 2023-07-18 18:14:41,284 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ea76dd957140528dc0af5a91446450 2023-07-18 18:14:41,284 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/c4ea76dd957140528dc0af5a91446450, entries=11, sequenceid=104, filesize=6.0 K 2023-07-18 18:14:41,285 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~39.91 KB/40867, heapSize ~61.40 KB/62872, currentSize=0 B/0 for 1588230740 in 149ms, sequenceid=104, compaction requested=false 2023-07-18 18:14:41,300 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/recovered.edits/107.seqid, newMaxSeqId=107, maxSeqId=19 2023-07-18 18:14:41,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:14:41,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:14:41,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:14:41,302 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding 1588230740 move to jenkins-hbase4.apache.org,46845,1689704069644 record at close sequenceid=104 2023-07-18 18:14:41,304 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1588230740 2023-07-18 18:14:41,304 WARN [PEWorker-1] zookeeper.MetaTableLocator(225): Tried to set null ServerName in hbase:meta; skipping -- ServerName required 2023-07-18 18:14:41,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-18 18:14:41,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46365,1689704073486 in 327 msec 2023-07-18 18:14:41,307 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:41,458 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46845,1689704069644, state=OPENING 2023-07-18 18:14:41,459 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:14:41,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:41,460 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:41,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 18:14:41,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:41,620 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46845%2C1689704069644.meta, suffix=.meta, logDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46845,1689704069644, archiveDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs, maxLogs=32 2023-07-18 18:14:41,642 DEBUG [RS-EventLoopGroup-7-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK] 2023-07-18 18:14:41,642 DEBUG [RS-EventLoopGroup-7-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK] 2023-07-18 18:14:41,642 DEBUG [RS-EventLoopGroup-7-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK] 2023-07-18 18:14:41,647 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/WALs/jenkins-hbase4.apache.org,46845,1689704069644/jenkins-hbase4.apache.org%2C46845%2C1689704069644.meta.1689704081621.meta 2023-07-18 18:14:41,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36517,DS-9f74f898-ef48-42cd-b652-bd68001cb39b,DISK], DatanodeInfoWithStorage[127.0.0.1:36519,DS-da902ba0-a8f3-44ab-b960-eb890394269f,DISK], DatanodeInfoWithStorage[127.0.0.1:34597,DS-2434a5f0-4978-4882-9122-7a16f314a7cc,DISK]] 2023-07-18 18:14:41,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:41,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:14:41,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 18:14:41,648 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 18:14:41,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 18:14:41,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:41,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 18:14:41,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 18:14:41,650 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:14:41,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info 2023-07-18 18:14:41,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info 2023-07-18 18:14:41,651 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:14:41,663 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/4b4dd9cda1b14d629d3e23b8c4e399ba 2023-07-18 18:14:41,671 INFO [StoreFileOpener-info-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0c72ba92a98468fb6147506a1b3ea6b 2023-07-18 18:14:41,672 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/c0c72ba92a98468fb6147506a1b3ea6b 2023-07-18 18:14:41,672 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:41,672 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:14:41,674 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:41,674 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:41,674 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:14:41,684 INFO [StoreFileOpener-rep_barrier-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff8182fb715f4886b429a57523a1a67b 2023-07-18 18:14:41,684 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier/ff8182fb715f4886b429a57523a1a67b 2023-07-18 18:14:41,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:41,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:14:41,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table 2023-07-18 18:14:41,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table 2023-07-18 18:14:41,686 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:14:41,695 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/11f997d24832439eaeafca4ff3b307b0 2023-07-18 18:14:41,701 INFO [StoreFileOpener-table-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ea76dd957140528dc0af5a91446450 2023-07-18 18:14:41,701 DEBUG [StoreOpener-1588230740-1] regionserver.HStore(539): loaded hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/c4ea76dd957140528dc0af5a91446450 2023-07-18 18:14:41,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:41,707 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740 2023-07-18 18:14:41,709 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740 2023-07-18 18:14:41,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:14:41,713 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:14:41,714 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=108; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11979480480, jitterRate=0.11567606031894684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:14:41,714 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:14:41,715 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=83, masterSystemTime=1689704081612 2023-07-18 18:14:41,717 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 18:14:41,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 18:14:41,717 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46845,1689704069644, state=OPEN 2023-07-18 18:14:41,719 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:14:41,719 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:41,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-07-18 18:14:41,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46845,1689704069644 in 259 msec 2023-07-18 18:14:41,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, REOPEN/MOVE in 748 msec 2023-07-18 18:14:41,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=81 2023-07-18 18:14:41,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417, jenkins-hbase4.apache.org,46365,1689704073486] are moved back to default 2023-07-18 18:14:41,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: default => bar 2023-07-18 18:14:41,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:41,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:41,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:41,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=bar 2023-07-18 18:14:41,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:41,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'Group_testFailRemoveGroup', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:41,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=Group_testFailRemoveGroup 2023-07-18 18:14:41,988 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=84, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=Group_testFailRemoveGroup execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:41,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "Group_testFailRemoveGroup" procId is: 84 2023-07-18 18:14:41,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:14:41,991 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:41,992 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/bar 2023-07-18 18:14:41,992 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:41,993 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:42,000 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=84, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=Group_testFailRemoveGroup execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:42,001 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46365] ipc.CallRunner(144): callId: 194 service: ClientService methodName: Get size: 142 connection: 172.31.14.131:41116 deadline: 1689704142001, exception=org.apache.hadoop.hbase.exceptions.RegionMovedException: Region moved to: hostname=jenkins-hbase4.apache.org port=46845 startCode=1689704069644. As of locationSeqNum=104. 2023-07-18 18:14:42,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:14:42,104 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,105 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe empty. 2023-07-18 18:14:42,105 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,105 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived Group_testFailRemoveGroup regions 2023-07-18 18:14:42,139 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:42,141 INFO [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4c57cc236f9f694fd21a98dd449505fe, NAME => 'Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='Group_testFailRemoveGroup', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:42,168 DEBUG [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(866): Instantiated Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:42,168 DEBUG [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(1604): Closing 4c57cc236f9f694fd21a98dd449505fe, disabling compactions & flushes 2023-07-18 18:14:42,168 INFO [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(1626): Closing region Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,168 DEBUG [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,168 DEBUG [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(1714): Acquired close lock on Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. after waiting 0 ms 2023-07-18 18:14:42,169 DEBUG [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(1724): Updates disabled for region Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,169 INFO [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(1838): Closed Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,169 DEBUG [RegionOpenAndInit-Group_testFailRemoveGroup-pool-0] regionserver.HRegion(1558): Region close journal for 4c57cc236f9f694fd21a98dd449505fe: 2023-07-18 18:14:42,172 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=84, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=Group_testFailRemoveGroup execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:42,173 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704082173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704082173"}]},"ts":"1689704082173"} 2023-07-18 18:14:42,175 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:14:42,177 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=84, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=Group_testFailRemoveGroup execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:42,177 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testFailRemoveGroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704082177"}]},"ts":"1689704082177"} 2023-07-18 18:14:42,178 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=Group_testFailRemoveGroup, state=ENABLING in hbase:meta 2023-07-18 18:14:42,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, ASSIGN}] 2023-07-18 18:14:42,186 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, ASSIGN 2023-07-18 18:14:42,187 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:42,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:14:42,338 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:42,339 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704082338"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704082338"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704082338"}]},"ts":"1689704082338"} 2023-07-18 18:14:42,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=86, ppid=85, state=RUNNABLE; OpenRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:42,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c57cc236f9f694fd21a98dd449505fe, NAME => 'Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:42,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testFailRemoveGroup 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:42,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,499 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,502 DEBUG [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/f 2023-07-18 18:14:42,502 DEBUG [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/f 2023-07-18 18:14:42,502 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c57cc236f9f694fd21a98dd449505fe columnFamilyName f 2023-07-18 18:14:42,503 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] regionserver.HStore(310): Store=4c57cc236f9f694fd21a98dd449505fe/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:42,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:42,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c57cc236f9f694fd21a98dd449505fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10761108320, jitterRate=0.0022063106298446655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:42,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c57cc236f9f694fd21a98dd449505fe: 2023-07-18 18:14:42,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe., pid=86, masterSystemTime=1689704082492 2023-07-18 18:14:42,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,528 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:42,528 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704082527"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704082527"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704082527"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704082527"}]},"ts":"1689704082527"} 2023-07-18 18:14:42,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=85 2023-07-18 18:14:42,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=85, state=SUCCESS; OpenRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46845,1689704069644 in 190 msec 2023-07-18 18:14:42,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-18 18:14:42,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, ASSIGN in 351 msec 2023-07-18 18:14:42,537 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=84, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=Group_testFailRemoveGroup execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:42,537 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testFailRemoveGroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704082537"}]},"ts":"1689704082537"} 2023-07-18 18:14:42,538 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=Group_testFailRemoveGroup, state=ENABLED in hbase:meta 2023-07-18 18:14:42,542 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=84, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=Group_testFailRemoveGroup execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:42,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; CreateTableProcedure table=Group_testFailRemoveGroup in 557 msec 2023-07-18 18:14:42,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:14:42,594 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:Group_testFailRemoveGroup, procId: 84 completed 2023-07-18 18:14:42,594 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(3430): Waiting until all regions of table Group_testFailRemoveGroup get assigned. Timeout = 60000ms 2023-07-18 18:14:42,595 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:42,595 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46365] ipc.CallRunner(144): callId: 276 service: ClientService methodName: Scan size: 96 connection: 172.31.14.131:41130 deadline: 1689704142595, exception=org.apache.hadoop.hbase.exceptions.RegionMovedException: Region moved to: hostname=jenkins-hbase4.apache.org port=46845 startCode=1689704069644. As of locationSeqNum=104. 2023-07-18 18:14:42,625 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-18 18:14:42,697 DEBUG [hconnection-0x497c82a-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:42,707 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:42,727 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3484): All regions for table Group_testFailRemoveGroup assigned to meta. Checking AM states. 2023-07-18 18:14:42,728 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:42,728 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3504): All regions for table Group_testFailRemoveGroup assigned. 2023-07-18 18:14:42,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [Group_testFailRemoveGroup] to rsgroup bar 2023-07-18 18:14:42,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:42,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/bar 2023-07-18 18:14:42,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:42,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:42,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table Group_testFailRemoveGroup to RSGroup bar 2023-07-18 18:14:42,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region 4c57cc236f9f694fd21a98dd449505fe to RSGroup bar 2023-07-18 18:14:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 0 2023-07-18 18:14:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:42,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, REOPEN/MOVE 2023-07-18 18:14:42,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 1 region(s) to group bar, current retry=0 2023-07-18 18:14:42,741 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=87, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, REOPEN/MOVE 2023-07-18 18:14:42,742 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=87 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:42,742 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704082742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704082742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704082742"}]},"ts":"1689704082742"} 2023-07-18 18:14:42,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=87, state=RUNNABLE; CloseRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:42,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c57cc236f9f694fd21a98dd449505fe, disabling compactions & flushes 2023-07-18 18:14:42,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. after waiting 0 ms 2023-07-18 18:14:42,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:42,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:42,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c57cc236f9f694fd21a98dd449505fe: 2023-07-18 18:14:42,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding 4c57cc236f9f694fd21a98dd449505fe move to jenkins-hbase4.apache.org,46365,1689704073486 record at close sequenceid=2 2023-07-18 18:14:42,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:42,916 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=87 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=CLOSED 2023-07-18 18:14:42,916 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704082916"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704082916"}]},"ts":"1689704082916"} 2023-07-18 18:14:42,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=87 2023-07-18 18:14:42,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=87, state=SUCCESS; CloseRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46845,1689704069644 in 173 msec 2023-07-18 18:14:42,922 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=87, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:43,073 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:43,073 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=87 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:43,073 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704083073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704083073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704083073"}]},"ts":"1689704083073"} 2023-07-18 18:14:43,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=87, state=RUNNABLE; OpenRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:43,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:43,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c57cc236f9f694fd21a98dd449505fe, NAME => 'Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:43,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testFailRemoveGroup 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:43,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,237 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,238 DEBUG [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/f 2023-07-18 18:14:43,238 DEBUG [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/f 2023-07-18 18:14:43,238 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c57cc236f9f694fd21a98dd449505fe columnFamilyName f 2023-07-18 18:14:43,239 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] regionserver.HStore(310): Store=4c57cc236f9f694fd21a98dd449505fe/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:43,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c57cc236f9f694fd21a98dd449505fe; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=12033380640, jitterRate=0.12069590389728546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:43,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c57cc236f9f694fd21a98dd449505fe: 2023-07-18 18:14:43,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe., pid=89, masterSystemTime=1689704083230 2023-07-18 18:14:43,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:43,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:43,250 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=87 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:43,250 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704083250"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704083250"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704083250"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704083250"}]},"ts":"1689704083250"} 2023-07-18 18:14:43,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=87 2023-07-18 18:14:43,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=87, state=SUCCESS; OpenRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46365,1689704073486 in 177 msec 2023-07-18 18:14:43,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, REOPEN/MOVE in 518 msec 2023-07-18 18:14:43,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=87 2023-07-18 18:14:43,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [Group_testFailRemoveGroup] moved to target group bar. 2023-07-18 18:14:43,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:43,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:43,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:43,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=bar 2023-07-18 18:14:43,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:43,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup bar 2023-07-18 18:14:43,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup bar has 1 tables; you must remove these tables from the rsgroup before the rsgroup can be removed. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.removeRSGroup(RSGroupAdminServer.java:490) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.removeRSGroup(RSGroupAdminEndpoint.java:278) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16208) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:43,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 286 service: MasterService methodName: ExecMasterService size: 85 connection: 172.31.14.131:58898 deadline: 1689705283754, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup bar has 1 tables; you must remove these tables from the rsgroup before the rsgroup can be removed. 2023-07-18 18:14:43,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:46365] to rsgroup default 2023-07-18 18:14:43,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Cannot leave a RSGroup bar that contains tables without servers to host them. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:428) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:43,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 288 service: MasterService methodName: ExecMasterService size: 188 connection: 172.31.14.131:58898 deadline: 1689705283756, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Cannot leave a RSGroup bar that contains tables without servers to host them. 2023-07-18 18:14:43,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [Group_testFailRemoveGroup] to rsgroup default 2023-07-18 18:14:43,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:43,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/bar 2023-07-18 18:14:43,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:43,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:43,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table Group_testFailRemoveGroup to RSGroup default 2023-07-18 18:14:43,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region 4c57cc236f9f694fd21a98dd449505fe to RSGroup default 2023-07-18 18:14:43,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, REOPEN/MOVE 2023-07-18 18:14:43,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 1 region(s) to group default, current retry=0 2023-07-18 18:14:43,769 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, REOPEN/MOVE 2023-07-18 18:14:43,770 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:43,770 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704083770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704083770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704083770"}]},"ts":"1689704083770"} 2023-07-18 18:14:43,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE; CloseRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:43,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c57cc236f9f694fd21a98dd449505fe, disabling compactions & flushes 2023-07-18 18:14:43,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:43,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:43,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. after waiting 0 ms 2023-07-18 18:14:43,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:43,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:43,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:43,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c57cc236f9f694fd21a98dd449505fe: 2023-07-18 18:14:43,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding 4c57cc236f9f694fd21a98dd449505fe move to jenkins-hbase4.apache.org,46845,1689704069644 record at close sequenceid=5 2023-07-18 18:14:43,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:43,936 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=CLOSED 2023-07-18 18:14:43,937 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704083936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704083936"}]},"ts":"1689704083936"} 2023-07-18 18:14:43,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-18 18:14:43,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; CloseRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46365,1689704073486 in 165 msec 2023-07-18 18:14:43,941 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:44,091 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:44,091 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704084091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704084091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704084091"}]},"ts":"1689704084091"} 2023-07-18 18:14:44,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; OpenRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:44,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:44,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c57cc236f9f694fd21a98dd449505fe, NAME => 'Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:44,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testFailRemoveGroup 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:44,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:44,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:44,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:44,251 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:44,253 DEBUG [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/f 2023-07-18 18:14:44,253 DEBUG [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/f 2023-07-18 18:14:44,253 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c57cc236f9f694fd21a98dd449505fe columnFamilyName f 2023-07-18 18:14:44,254 INFO [StoreOpener-4c57cc236f9f694fd21a98dd449505fe-1] regionserver.HStore(310): Store=4c57cc236f9f694fd21a98dd449505fe/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:44,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:44,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:44,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:44,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c57cc236f9f694fd21a98dd449505fe; next sequenceid=8; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9950096960, jitterRate=-0.0733250081539154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:44,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c57cc236f9f694fd21a98dd449505fe: 2023-07-18 18:14:44,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe., pid=92, masterSystemTime=1689704084245 2023-07-18 18:14:44,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:44,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:44,263 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=OPEN, openSeqNum=8, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:44,263 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704084263"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704084263"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704084263"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704084263"}]},"ts":"1689704084263"} 2023-07-18 18:14:44,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-18 18:14:44,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; OpenRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46845,1689704069644 in 172 msec 2023-07-18 18:14:44,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, REOPEN/MOVE in 499 msec 2023-07-18 18:14:44,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=90 2023-07-18 18:14:44,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [Group_testFailRemoveGroup] moved to target group default. 2023-07-18 18:14:44,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:44,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:44,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:44,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup bar 2023-07-18 18:14:44,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup bar has 3 servers; you must remove these servers from the RSGroup beforethe RSGroup can be removed. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.removeRSGroup(RSGroupAdminServer.java:496) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.removeRSGroup(RSGroupAdminEndpoint.java:278) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16208) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:44,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 295 service: MasterService methodName: ExecMasterService size: 85 connection: 172.31.14.131:58898 deadline: 1689705284777, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup bar has 3 servers; you must remove these servers from the RSGroup beforethe RSGroup can be removed. 2023-07-18 18:14:44,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:46365] to rsgroup default 2023-07-18 18:14:44,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:44,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/bar 2023-07-18 18:14:44,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:44,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:44,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group bar, current retry=0 2023-07-18 18:14:44,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417, jenkins-hbase4.apache.org,46365,1689704073486] are moved back to bar 2023-07-18 18:14:44,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: bar => default 2023-07-18 18:14:44,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:44,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:44,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:44,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup bar 2023-07-18 18:14:44,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:44,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:44,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 5 2023-07-18 18:14:44,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:45,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,011 INFO [Listener at localhost/35951] client.HBaseAdmin$15(890): Started disable of Group_testFailRemoveGroup 2023-07-18 18:14:45,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable Group_testFailRemoveGroup 2023-07-18 18:14:45,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=93, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=Group_testFailRemoveGroup 2023-07-18 18:14:45,017 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testFailRemoveGroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704085017"}]},"ts":"1689704085017"} 2023-07-18 18:14:45,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=93 2023-07-18 18:14:45,019 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=Group_testFailRemoveGroup, state=DISABLING in hbase:meta 2023-07-18 18:14:45,021 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set Group_testFailRemoveGroup to state=DISABLING 2023-07-18 18:14:45,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=93, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, UNASSIGN}] 2023-07-18 18:14:45,027 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=94, ppid=93, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, UNASSIGN 2023-07-18 18:14:45,028 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=94 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:45,028 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704085028"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704085028"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704085028"}]},"ts":"1689704085028"} 2023-07-18 18:14:45,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=95, ppid=94, state=RUNNABLE; CloseRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:45,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=93 2023-07-18 18:14:45,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:45,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c57cc236f9f694fd21a98dd449505fe, disabling compactions & flushes 2023-07-18 18:14:45,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:45,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:45,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. after waiting 0 ms 2023-07-18 18:14:45,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:45,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=7 2023-07-18 18:14:45,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe. 2023-07-18 18:14:45,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c57cc236f9f694fd21a98dd449505fe: 2023-07-18 18:14:45,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:45,192 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=94 updating hbase:meta row=4c57cc236f9f694fd21a98dd449505fe, regionState=CLOSED 2023-07-18 18:14:45,192 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"regioninfo","vlen":59,"tag":[],"timestamp":"1689704085192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704085192"}]},"ts":"1689704085192"} 2023-07-18 18:14:45,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=95, resume processing ppid=94 2023-07-18 18:14:45,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, ppid=94, state=SUCCESS; CloseRegionProcedure 4c57cc236f9f694fd21a98dd449505fe, server=jenkins-hbase4.apache.org,46845,1689704069644 in 164 msec 2023-07-18 18:14:45,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=93 2023-07-18 18:14:45,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=93, state=SUCCESS; TransitRegionStateProcedure table=Group_testFailRemoveGroup, region=4c57cc236f9f694fd21a98dd449505fe, UNASSIGN in 173 msec 2023-07-18 18:14:45,198 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testFailRemoveGroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704085197"}]},"ts":"1689704085197"} 2023-07-18 18:14:45,199 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=Group_testFailRemoveGroup, state=DISABLED in hbase:meta 2023-07-18 18:14:45,200 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set Group_testFailRemoveGroup to state=DISABLED 2023-07-18 18:14:45,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, state=SUCCESS; DisableTableProcedure table=Group_testFailRemoveGroup in 190 msec 2023-07-18 18:14:45,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=93 2023-07-18 18:14:45,320 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:Group_testFailRemoveGroup, procId: 93 completed 2023-07-18 18:14:45,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete Group_testFailRemoveGroup 2023-07-18 18:14:45,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=Group_testFailRemoveGroup 2023-07-18 18:14:45,325 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=96, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=Group_testFailRemoveGroup 2023-07-18 18:14:45,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint(577): Removing deleted table 'Group_testFailRemoveGroup' from rsgroup 'default' 2023-07-18 18:14:45,326 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=96, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=Group_testFailRemoveGroup 2023-07-18 18:14:45,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:45,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:45,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:45,330 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:45,331 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/recovered.edits] 2023-07-18 18:14:45,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-18 18:14:45,337 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/recovered.edits/10.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe/recovered.edits/10.seqid 2023-07-18 18:14:45,337 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testFailRemoveGroup/4c57cc236f9f694fd21a98dd449505fe 2023-07-18 18:14:45,337 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived Group_testFailRemoveGroup regions 2023-07-18 18:14:45,340 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=96, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=Group_testFailRemoveGroup 2023-07-18 18:14:45,342 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of Group_testFailRemoveGroup from hbase:meta 2023-07-18 18:14:45,344 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'Group_testFailRemoveGroup' descriptor. 2023-07-18 18:14:45,345 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=96, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=Group_testFailRemoveGroup 2023-07-18 18:14:45,345 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'Group_testFailRemoveGroup' from region states. 2023-07-18 18:14:45,345 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704085345"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:45,347 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 18:14:45,347 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4c57cc236f9f694fd21a98dd449505fe, NAME => 'Group_testFailRemoveGroup,,1689704081985.4c57cc236f9f694fd21a98dd449505fe.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 18:14:45,347 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'Group_testFailRemoveGroup' as deleted. 2023-07-18 18:14:45,347 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testFailRemoveGroup","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689704085347"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:45,348 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table Group_testFailRemoveGroup state from META 2023-07-18 18:14:45,351 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=96, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=Group_testFailRemoveGroup 2023-07-18 18:14:45,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; DeleteTableProcedure table=Group_testFailRemoveGroup in 29 msec 2023-07-18 18:14:45,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-07-18 18:14:45,435 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:Group_testFailRemoveGroup, procId: 96 completed 2023-07-18 18:14:45,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:45,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:45,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:45,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:45,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:45,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:45,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:45,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:45,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:45,452 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:45,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:45,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:45,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:45,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:45,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:45,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:45,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:45,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 343 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705285465, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:45,466 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:45,468 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:45,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,469 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:45,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:45,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:45,491 INFO [Listener at localhost/35951] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testFailRemoveGroup Thread=526 (was 508) Potentially hanging thread: hconnection-0x120ad869-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741861_1037, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1117110726_17 at /127.0.0.1:58168 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1288938615_17 at /127.0.0.1:44498 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741861_1037] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741861_1037, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1117110726_17 at /127.0.0.1:41448 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_340288162_17 at /127.0.0.1:58198 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1288938615_17 at /127.0.0.1:43310 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1117110726_17 at /127.0.0.1:58124 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1288938615_17 at /127.0.0.1:40770 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741861_1037] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1117110726_17 at /127.0.0.1:44494 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c-prefix:jenkins-hbase4.apache.org,46845,1689704069644.meta sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1117110726_17 at /127.0.0.1:58164 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x497c82a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-14 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1288938615_17 at /127.0.0.1:58150 [Receiving block BP-803566363-172.31.14.131-1689704063768:blk_1073741861_1037] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-13 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1117110726_17 at /127.0.0.1:58176 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-803566363-172.31.14.131-1689704063768:blk_1073741861_1037, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=841 (was 819) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=437 (was 457), ProcessCount=173 (was 173), AvailableMemoryMB=3215 (was 3404) 2023-07-18 18:14:45,492 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=526 is superior to 500 2023-07-18 18:14:45,511 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testMultiTableMove Thread=526, OpenFileDescriptor=841, MaxFileDescriptor=60000, SystemLoadAverage=437, ProcessCount=173, AvailableMemoryMB=3214 2023-07-18 18:14:45,511 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=526 is superior to 500 2023-07-18 18:14:45,511 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testMultiTableMove 2023-07-18 18:14:45,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:45,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:45,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:45,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:45,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:45,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:45,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:45,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:45,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:45,529 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:45,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:45,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:45,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:45,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:45,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:45,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:45,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:45,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 371 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705285541, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:45,542 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:45,547 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:45,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,559 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:45,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:45,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:45,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:45,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:45,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup Group_testMultiTableMove_1813991631 2023-07-18 18:14:45,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:45,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:45,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:45,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:45,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:45,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:36811] to rsgroup Group_testMultiTableMove_1813991631 2023-07-18 18:14:45,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:45,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:45,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:45,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:45,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group default, current retry=0 2023-07-18 18:14:45,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850] are moved back to default 2023-07-18 18:14:45,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: default => Group_testMultiTableMove_1813991631 2023-07-18 18:14:45,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:45,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:45,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:45,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=Group_testMultiTableMove_1813991631 2023-07-18 18:14:45,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:45,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'GrouptestMultiTableMoveA', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:45,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=GrouptestMultiTableMoveA 2023-07-18 18:14:45,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=97, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveA execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:45,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "GrouptestMultiTableMoveA" procId is: 97 2023-07-18 18:14:45,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-18 18:14:45,603 DEBUG [PEWorker-3] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:45,604 DEBUG [PEWorker-3] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:45,604 DEBUG [PEWorker-3] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:45,605 DEBUG [PEWorker-3] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:45,610 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=97, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveA execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:45,612 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:45,613 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae empty. 2023-07-18 18:14:45,613 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:45,613 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived GrouptestMultiTableMoveA regions 2023-07-18 18:14:45,629 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:45,631 INFO [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(7675): creating {ENCODED => ace9c65a5204f37d6dd25eb9c4952cae, NAME => 'GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='GrouptestMultiTableMoveA', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:45,642 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(866): Instantiated GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:45,642 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(1604): Closing ace9c65a5204f37d6dd25eb9c4952cae, disabling compactions & flushes 2023-07-18 18:14:45,642 INFO [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(1626): Closing region GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:45,642 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:45,642 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(1714): Acquired close lock on GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. after waiting 0 ms 2023-07-18 18:14:45,642 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(1724): Updates disabled for region GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:45,642 INFO [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(1838): Closed GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:45,642 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveA-pool-0] regionserver.HRegion(1558): Region close journal for ace9c65a5204f37d6dd25eb9c4952cae: 2023-07-18 18:14:45,645 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=97, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveA execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:45,646 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704085645"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704085645"}]},"ts":"1689704085645"} 2023-07-18 18:14:45,647 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:14:45,647 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=97, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveA execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:45,648 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"GrouptestMultiTableMoveA","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704085648"}]},"ts":"1689704085648"} 2023-07-18 18:14:45,649 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=GrouptestMultiTableMoveA, state=ENABLING in hbase:meta 2023-07-18 18:14:45,653 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:45,653 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:45,653 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:45,653 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:45,653 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:45,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, ASSIGN}] 2023-07-18 18:14:45,655 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, ASSIGN 2023-07-18 18:14:45,656 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43237,1689704069417; forceNewPlan=false, retain=false 2023-07-18 18:14:45,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-18 18:14:45,806 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:45,808 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=ace9c65a5204f37d6dd25eb9c4952cae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:45,808 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704085808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704085808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704085808"}]},"ts":"1689704085808"} 2023-07-18 18:14:45,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=99, ppid=98, state=RUNNABLE; OpenRegionProcedure ace9c65a5204f37d6dd25eb9c4952cae, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:45,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-18 18:14:45,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:45,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ace9c65a5204f37d6dd25eb9c4952cae, NAME => 'GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table GrouptestMultiTableMoveA ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:45,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:45,974 INFO [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:45,976 DEBUG [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/f 2023-07-18 18:14:45,976 DEBUG [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/f 2023-07-18 18:14:45,976 INFO [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ace9c65a5204f37d6dd25eb9c4952cae columnFamilyName f 2023-07-18 18:14:45,977 INFO [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] regionserver.HStore(310): Store=ace9c65a5204f37d6dd25eb9c4952cae/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:45,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:45,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:45,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:46,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:46,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ace9c65a5204f37d6dd25eb9c4952cae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11918484480, jitterRate=0.10999536514282227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:46,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ace9c65a5204f37d6dd25eb9c4952cae: 2023-07-18 18:14:46,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae., pid=99, masterSystemTime=1689704085965 2023-07-18 18:14:46,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:46,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:46,013 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=ace9c65a5204f37d6dd25eb9c4952cae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:46,013 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704086012"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704086012"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704086012"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704086012"}]},"ts":"1689704086012"} 2023-07-18 18:14:46,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=98 2023-07-18 18:14:46,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=98, state=SUCCESS; OpenRegionProcedure ace9c65a5204f37d6dd25eb9c4952cae, server=jenkins-hbase4.apache.org,43237,1689704069417 in 205 msec 2023-07-18 18:14:46,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-07-18 18:14:46,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, ASSIGN in 364 msec 2023-07-18 18:14:46,020 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=97, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveA execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:46,020 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"GrouptestMultiTableMoveA","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704086020"}]},"ts":"1689704086020"} 2023-07-18 18:14:46,022 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=GrouptestMultiTableMoveA, state=ENABLED in hbase:meta 2023-07-18 18:14:46,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=97, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveA execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:46,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; CreateTableProcedure table=GrouptestMultiTableMoveA in 427 msec 2023-07-18 18:14:46,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-07-18 18:14:46,206 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:GrouptestMultiTableMoveA, procId: 97 completed 2023-07-18 18:14:46,206 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(3430): Waiting until all regions of table GrouptestMultiTableMoveA get assigned. Timeout = 60000ms 2023-07-18 18:14:46,206 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:46,213 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3484): All regions for table GrouptestMultiTableMoveA assigned to meta. Checking AM states. 2023-07-18 18:14:46,213 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:46,213 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3504): All regions for table GrouptestMultiTableMoveA assigned. 2023-07-18 18:14:46,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'GrouptestMultiTableMoveB', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:46,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=100, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=GrouptestMultiTableMoveB 2023-07-18 18:14:46,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=100, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveB execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:46,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "GrouptestMultiTableMoveB" procId is: 100 2023-07-18 18:14:46,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=100 2023-07-18 18:14:46,226 DEBUG [PEWorker-4] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:46,227 DEBUG [PEWorker-4] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:46,228 DEBUG [PEWorker-4] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:46,228 DEBUG [PEWorker-4] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:46,231 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=100, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveB execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:46,233 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,233 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 empty. 2023-07-18 18:14:46,234 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,234 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived GrouptestMultiTableMoveB regions 2023-07-18 18:14:46,290 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:46,292 INFO [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(7675): creating {ENCODED => aaa5d1563f01bc28d422b03a342188f0, NAME => 'GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='GrouptestMultiTableMoveB', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:46,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=100 2023-07-18 18:14:46,328 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(866): Instantiated GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:46,328 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(1604): Closing aaa5d1563f01bc28d422b03a342188f0, disabling compactions & flushes 2023-07-18 18:14:46,328 INFO [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(1626): Closing region GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:46,328 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:46,328 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(1714): Acquired close lock on GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. after waiting 0 ms 2023-07-18 18:14:46,328 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(1724): Updates disabled for region GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:46,328 INFO [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(1838): Closed GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:46,329 DEBUG [RegionOpenAndInit-GrouptestMultiTableMoveB-pool-0] regionserver.HRegion(1558): Region close journal for aaa5d1563f01bc28d422b03a342188f0: 2023-07-18 18:14:46,332 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=100, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveB execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:46,333 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704086333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704086333"}]},"ts":"1689704086333"} 2023-07-18 18:14:46,335 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:14:46,336 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=100, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveB execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:46,336 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"GrouptestMultiTableMoveB","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704086336"}]},"ts":"1689704086336"} 2023-07-18 18:14:46,338 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=GrouptestMultiTableMoveB, state=ENABLING in hbase:meta 2023-07-18 18:14:46,341 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:46,341 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:46,341 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:46,341 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:46,341 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:46,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, ASSIGN}] 2023-07-18 18:14:46,344 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=100, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, ASSIGN 2023-07-18 18:14:46,346 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=101, ppid=100, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:46,496 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:46,498 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=aaa5d1563f01bc28d422b03a342188f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:46,498 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704086498"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704086498"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704086498"}]},"ts":"1689704086498"} 2023-07-18 18:14:46,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; OpenRegionProcedure aaa5d1563f01bc28d422b03a342188f0, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:46,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=100 2023-07-18 18:14:46,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:46,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aaa5d1563f01bc28d422b03a342188f0, NAME => 'GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:46,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table GrouptestMultiTableMoveB aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:46,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,660 INFO [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,662 DEBUG [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/f 2023-07-18 18:14:46,662 DEBUG [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/f 2023-07-18 18:14:46,662 INFO [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aaa5d1563f01bc28d422b03a342188f0 columnFamilyName f 2023-07-18 18:14:46,663 INFO [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] regionserver.HStore(310): Store=aaa5d1563f01bc28d422b03a342188f0/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:46,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:46,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:46,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aaa5d1563f01bc28d422b03a342188f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11121600640, jitterRate=0.03577977418899536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:46,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aaa5d1563f01bc28d422b03a342188f0: 2023-07-18 18:14:46,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0., pid=102, masterSystemTime=1689704086653 2023-07-18 18:14:46,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:46,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:46,673 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=aaa5d1563f01bc28d422b03a342188f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:46,674 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704086673"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704086673"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704086673"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704086673"}]},"ts":"1689704086673"} 2023-07-18 18:14:46,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-18 18:14:46,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; OpenRegionProcedure aaa5d1563f01bc28d422b03a342188f0, server=jenkins-hbase4.apache.org,46365,1689704073486 in 175 msec 2023-07-18 18:14:46,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-07-18 18:14:46,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, ASSIGN in 335 msec 2023-07-18 18:14:46,680 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=100, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveB execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:46,680 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"GrouptestMultiTableMoveB","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704086680"}]},"ts":"1689704086680"} 2023-07-18 18:14:46,681 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=GrouptestMultiTableMoveB, state=ENABLED in hbase:meta 2023-07-18 18:14:46,684 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=100, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=GrouptestMultiTableMoveB execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:46,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, state=SUCCESS; CreateTableProcedure table=GrouptestMultiTableMoveB in 469 msec 2023-07-18 18:14:46,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=100 2023-07-18 18:14:46,832 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:GrouptestMultiTableMoveB, procId: 100 completed 2023-07-18 18:14:46,832 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(3430): Waiting until all regions of table GrouptestMultiTableMoveB get assigned. Timeout = 60000ms 2023-07-18 18:14:46,832 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:46,836 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3484): All regions for table GrouptestMultiTableMoveB assigned to meta. Checking AM states. 2023-07-18 18:14:46,836 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:46,836 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3504): All regions for table GrouptestMultiTableMoveB assigned. 2023-07-18 18:14:46,837 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:46,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=GrouptestMultiTableMoveA 2023-07-18 18:14:46,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:46,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=GrouptestMultiTableMoveB 2023-07-18 18:14:46,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:46,855 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsAdmin1(262): Moving table [GrouptestMultiTableMoveA,GrouptestMultiTableMoveB] to Group_testMultiTableMove_1813991631 2023-07-18 18:14:46,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [GrouptestMultiTableMoveB, GrouptestMultiTableMoveA] to rsgroup Group_testMultiTableMove_1813991631 2023-07-18 18:14:46,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:46,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:46,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:46,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:46,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table GrouptestMultiTableMoveB to RSGroup Group_testMultiTableMove_1813991631 2023-07-18 18:14:46,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region aaa5d1563f01bc28d422b03a342188f0 to RSGroup Group_testMultiTableMove_1813991631 2023-07-18 18:14:46,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=103, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, REOPEN/MOVE 2023-07-18 18:14:46,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table GrouptestMultiTableMoveA to RSGroup Group_testMultiTableMove_1813991631 2023-07-18 18:14:46,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region ace9c65a5204f37d6dd25eb9c4952cae to RSGroup Group_testMultiTableMove_1813991631 2023-07-18 18:14:46,869 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=103, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, REOPEN/MOVE 2023-07-18 18:14:46,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, REOPEN/MOVE 2023-07-18 18:14:46,870 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=103 updating hbase:meta row=aaa5d1563f01bc28d422b03a342188f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:46,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 2 region(s) to group Group_testMultiTableMove_1813991631, current retry=0 2023-07-18 18:14:46,874 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=104, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, REOPEN/MOVE 2023-07-18 18:14:46,874 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704086870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704086870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704086870"}]},"ts":"1689704086870"} 2023-07-18 18:14:46,875 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=104 updating hbase:meta row=ace9c65a5204f37d6dd25eb9c4952cae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:46,875 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704086875"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704086875"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704086875"}]},"ts":"1689704086875"} 2023-07-18 18:14:46,878 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=105, ppid=103, state=RUNNABLE; CloseRegionProcedure aaa5d1563f01bc28d422b03a342188f0, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:46,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=104, state=RUNNABLE; CloseRegionProcedure ace9c65a5204f37d6dd25eb9c4952cae, server=jenkins-hbase4.apache.org,43237,1689704069417}] 2023-07-18 18:14:47,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aaa5d1563f01bc28d422b03a342188f0, disabling compactions & flushes 2023-07-18 18:14:47,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ace9c65a5204f37d6dd25eb9c4952cae, disabling compactions & flushes 2023-07-18 18:14:47,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:47,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:47,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:47,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:47,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. after waiting 0 ms 2023-07-18 18:14:47,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:47,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. after waiting 0 ms 2023-07-18 18:14:47,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:47,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:47,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:47,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:47,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ace9c65a5204f37d6dd25eb9c4952cae: 2023-07-18 18:14:47,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding ace9c65a5204f37d6dd25eb9c4952cae move to jenkins-hbase4.apache.org,36811,1689704069850 record at close sequenceid=2 2023-07-18 18:14:47,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:47,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=104 updating hbase:meta row=ace9c65a5204f37d6dd25eb9c4952cae, regionState=CLOSED 2023-07-18 18:14:47,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aaa5d1563f01bc28d422b03a342188f0: 2023-07-18 18:14:47,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding aaa5d1563f01bc28d422b03a342188f0 move to jenkins-hbase4.apache.org,36811,1689704069850 record at close sequenceid=2 2023-07-18 18:14:47,051 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704087051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704087051"}]},"ts":"1689704087051"} 2023-07-18 18:14:47,061 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=103 updating hbase:meta row=aaa5d1563f01bc28d422b03a342188f0, regionState=CLOSED 2023-07-18 18:14:47,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,062 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704087061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704087061"}]},"ts":"1689704087061"} 2023-07-18 18:14:47,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=104 2023-07-18 18:14:47,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=104, state=SUCCESS; CloseRegionProcedure ace9c65a5204f37d6dd25eb9c4952cae, server=jenkins-hbase4.apache.org,43237,1689704069417 in 176 msec 2023-07-18 18:14:47,066 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=104, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36811,1689704069850; forceNewPlan=false, retain=false 2023-07-18 18:14:47,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=105, resume processing ppid=103 2023-07-18 18:14:47,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, ppid=103, state=SUCCESS; CloseRegionProcedure aaa5d1563f01bc28d422b03a342188f0, server=jenkins-hbase4.apache.org,46365,1689704073486 in 187 msec 2023-07-18 18:14:47,068 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=103, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36811,1689704069850; forceNewPlan=false, retain=false 2023-07-18 18:14:47,216 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=103 updating hbase:meta row=aaa5d1563f01bc28d422b03a342188f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:47,216 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=104 updating hbase:meta row=ace9c65a5204f37d6dd25eb9c4952cae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:47,217 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704087216"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704087216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704087216"}]},"ts":"1689704087216"} 2023-07-18 18:14:47,217 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704087216"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704087216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704087216"}]},"ts":"1689704087216"} 2023-07-18 18:14:47,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=107, ppid=103, state=RUNNABLE; OpenRegionProcedure aaa5d1563f01bc28d422b03a342188f0, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:47,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=104, state=RUNNABLE; OpenRegionProcedure ace9c65a5204f37d6dd25eb9c4952cae, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:47,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:47,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aaa5d1563f01bc28d422b03a342188f0, NAME => 'GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table GrouptestMultiTableMoveB aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,378 INFO [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,379 DEBUG [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/f 2023-07-18 18:14:47,379 DEBUG [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/f 2023-07-18 18:14:47,380 INFO [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aaa5d1563f01bc28d422b03a342188f0 columnFamilyName f 2023-07-18 18:14:47,380 INFO [StoreOpener-aaa5d1563f01bc28d422b03a342188f0-1] regionserver.HStore(310): Store=aaa5d1563f01bc28d422b03a342188f0/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:47,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:47,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aaa5d1563f01bc28d422b03a342188f0; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=12017955840, jitterRate=0.11925935745239258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:47,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aaa5d1563f01bc28d422b03a342188f0: 2023-07-18 18:14:47,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0., pid=107, masterSystemTime=1689704087371 2023-07-18 18:14:47,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:47,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:47,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:47,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ace9c65a5204f37d6dd25eb9c4952cae, NAME => 'GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:47,393 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=103 updating hbase:meta row=aaa5d1563f01bc28d422b03a342188f0, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:47,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table GrouptestMultiTableMoveA ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,394 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704087393"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704087393"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704087393"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704087393"}]},"ts":"1689704087393"} 2023-07-18 18:14:47,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:47,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,397 INFO [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,399 DEBUG [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/f 2023-07-18 18:14:47,399 DEBUG [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/f 2023-07-18 18:14:47,399 INFO [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ace9c65a5204f37d6dd25eb9c4952cae columnFamilyName f 2023-07-18 18:14:47,400 INFO [StoreOpener-ace9c65a5204f37d6dd25eb9c4952cae-1] regionserver.HStore(310): Store=ace9c65a5204f37d6dd25eb9c4952cae/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:47,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=103 2023-07-18 18:14:47,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=103, state=SUCCESS; OpenRegionProcedure aaa5d1563f01bc28d422b03a342188f0, server=jenkins-hbase4.apache.org,36811,1689704069850 in 179 msec 2023-07-18 18:14:47,405 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, state=SUCCESS; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, REOPEN/MOVE in 537 msec 2023-07-18 18:14:47,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:47,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ace9c65a5204f37d6dd25eb9c4952cae; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10254751680, jitterRate=-0.044951826333999634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:47,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ace9c65a5204f37d6dd25eb9c4952cae: 2023-07-18 18:14:47,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae., pid=108, masterSystemTime=1689704087371 2023-07-18 18:14:47,418 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=104 updating hbase:meta row=ace9c65a5204f37d6dd25eb9c4952cae, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:47,418 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704087418"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704087418"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704087418"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704087418"}]},"ts":"1689704087418"} 2023-07-18 18:14:47,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:47,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:47,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=104 2023-07-18 18:14:47,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=104, state=SUCCESS; OpenRegionProcedure ace9c65a5204f37d6dd25eb9c4952cae, server=jenkins-hbase4.apache.org,36811,1689704069850 in 201 msec 2023-07-18 18:14:47,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, REOPEN/MOVE in 554 msec 2023-07-18 18:14:47,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=103 2023-07-18 18:14:47,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [GrouptestMultiTableMoveB, GrouptestMultiTableMoveA] moved to target group Group_testMultiTableMove_1813991631. 2023-07-18 18:14:47,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:47,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:47,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:47,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=GrouptestMultiTableMoveA 2023-07-18 18:14:47,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:47,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=GrouptestMultiTableMoveB 2023-07-18 18:14:47,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:47,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:47,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:47,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=Group_testMultiTableMove_1813991631 2023-07-18 18:14:47,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:47,886 INFO [Listener at localhost/35951] client.HBaseAdmin$15(890): Started disable of GrouptestMultiTableMoveA 2023-07-18 18:14:47,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable GrouptestMultiTableMoveA 2023-07-18 18:14:47,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=109, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=GrouptestMultiTableMoveA 2023-07-18 18:14:47,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=109 2023-07-18 18:14:47,891 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"GrouptestMultiTableMoveA","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704087891"}]},"ts":"1689704087891"} 2023-07-18 18:14:47,892 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=GrouptestMultiTableMoveA, state=DISABLING in hbase:meta 2023-07-18 18:14:47,894 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set GrouptestMultiTableMoveA to state=DISABLING 2023-07-18 18:14:47,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=109, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, UNASSIGN}] 2023-07-18 18:14:47,896 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=110, ppid=109, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, UNASSIGN 2023-07-18 18:14:47,897 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=110 updating hbase:meta row=ace9c65a5204f37d6dd25eb9c4952cae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:47,897 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704087897"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704087897"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704087897"}]},"ts":"1689704087897"} 2023-07-18 18:14:47,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=110, state=RUNNABLE; CloseRegionProcedure ace9c65a5204f37d6dd25eb9c4952cae, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:47,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=109 2023-07-18 18:14:48,000 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-18 18:14:48,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:48,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ace9c65a5204f37d6dd25eb9c4952cae, disabling compactions & flushes 2023-07-18 18:14:48,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:48,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:48,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. after waiting 0 ms 2023-07-18 18:14:48,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:48,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:48,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae. 2023-07-18 18:14:48,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ace9c65a5204f37d6dd25eb9c4952cae: 2023-07-18 18:14:48,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:48,060 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=110 updating hbase:meta row=ace9c65a5204f37d6dd25eb9c4952cae, regionState=CLOSED 2023-07-18 18:14:48,060 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704088060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704088060"}]},"ts":"1689704088060"} 2023-07-18 18:14:48,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=110 2023-07-18 18:14:48,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=110, state=SUCCESS; CloseRegionProcedure ace9c65a5204f37d6dd25eb9c4952cae, server=jenkins-hbase4.apache.org,36811,1689704069850 in 163 msec 2023-07-18 18:14:48,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=109 2023-07-18 18:14:48,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=109, state=SUCCESS; TransitRegionStateProcedure table=GrouptestMultiTableMoveA, region=ace9c65a5204f37d6dd25eb9c4952cae, UNASSIGN in 168 msec 2023-07-18 18:14:48,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"GrouptestMultiTableMoveA","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704088065"}]},"ts":"1689704088065"} 2023-07-18 18:14:48,067 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=GrouptestMultiTableMoveA, state=DISABLED in hbase:meta 2023-07-18 18:14:48,069 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set GrouptestMultiTableMoveA to state=DISABLED 2023-07-18 18:14:48,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, state=SUCCESS; DisableTableProcedure table=GrouptestMultiTableMoveA in 184 msec 2023-07-18 18:14:48,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=109 2023-07-18 18:14:48,193 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:GrouptestMultiTableMoveA, procId: 109 completed 2023-07-18 18:14:48,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete GrouptestMultiTableMoveA 2023-07-18 18:14:48,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=GrouptestMultiTableMoveA 2023-07-18 18:14:48,197 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=112, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveA 2023-07-18 18:14:48,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint(577): Removing deleted table 'GrouptestMultiTableMoveA' from rsgroup 'Group_testMultiTableMove_1813991631' 2023-07-18 18:14:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:48,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:48,203 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=112, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveA 2023-07-18 18:14:48,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-18 18:14:48,209 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:48,212 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/recovered.edits] 2023-07-18 18:14:48,218 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/recovered.edits/7.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae/recovered.edits/7.seqid 2023-07-18 18:14:48,218 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveA/ace9c65a5204f37d6dd25eb9c4952cae 2023-07-18 18:14:48,218 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived GrouptestMultiTableMoveA regions 2023-07-18 18:14:48,222 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=112, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveA 2023-07-18 18:14:48,224 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of GrouptestMultiTableMoveA from hbase:meta 2023-07-18 18:14:48,226 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'GrouptestMultiTableMoveA' descriptor. 2023-07-18 18:14:48,227 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=112, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveA 2023-07-18 18:14:48,227 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'GrouptestMultiTableMoveA' from region states. 2023-07-18 18:14:48,227 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704088227"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:48,229 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 18:14:48,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ace9c65a5204f37d6dd25eb9c4952cae, NAME => 'GrouptestMultiTableMoveA,,1689704085597.ace9c65a5204f37d6dd25eb9c4952cae.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 18:14:48,229 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'GrouptestMultiTableMoveA' as deleted. 2023-07-18 18:14:48,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"GrouptestMultiTableMoveA","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689704088229"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:48,231 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table GrouptestMultiTableMoveA state from META 2023-07-18 18:14:48,233 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=112, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveA 2023-07-18 18:14:48,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; DeleteTableProcedure table=GrouptestMultiTableMoveA in 40 msec 2023-07-18 18:14:48,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-07-18 18:14:48,306 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:GrouptestMultiTableMoveA, procId: 112 completed 2023-07-18 18:14:48,306 INFO [Listener at localhost/35951] client.HBaseAdmin$15(890): Started disable of GrouptestMultiTableMoveB 2023-07-18 18:14:48,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable GrouptestMultiTableMoveB 2023-07-18 18:14:48,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=GrouptestMultiTableMoveB 2023-07-18 18:14:48,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=113 2023-07-18 18:14:48,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"GrouptestMultiTableMoveB","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704088311"}]},"ts":"1689704088311"} 2023-07-18 18:14:48,314 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=GrouptestMultiTableMoveB, state=DISABLING in hbase:meta 2023-07-18 18:14:48,318 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set GrouptestMultiTableMoveB to state=DISABLING 2023-07-18 18:14:48,319 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, UNASSIGN}] 2023-07-18 18:14:48,321 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=114, ppid=113, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, UNASSIGN 2023-07-18 18:14:48,322 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=114 updating hbase:meta row=aaa5d1563f01bc28d422b03a342188f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:48,322 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704088321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704088321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704088321"}]},"ts":"1689704088321"} 2023-07-18 18:14:48,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE; CloseRegionProcedure aaa5d1563f01bc28d422b03a342188f0, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:48,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=113 2023-07-18 18:14:48,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:48,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aaa5d1563f01bc28d422b03a342188f0, disabling compactions & flushes 2023-07-18 18:14:48,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:48,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:48,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. after waiting 0 ms 2023-07-18 18:14:48,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:48,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:48,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0. 2023-07-18 18:14:48,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aaa5d1563f01bc28d422b03a342188f0: 2023-07-18 18:14:48,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:48,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=114 updating hbase:meta row=aaa5d1563f01bc28d422b03a342188f0, regionState=CLOSED 2023-07-18 18:14:48,485 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"regioninfo","vlen":58,"tag":[],"timestamp":"1689704088485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704088485"}]},"ts":"1689704088485"} 2023-07-18 18:14:48,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-18 18:14:48,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; CloseRegionProcedure aaa5d1563f01bc28d422b03a342188f0, server=jenkins-hbase4.apache.org,36811,1689704069850 in 164 msec 2023-07-18 18:14:48,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-07-18 18:14:48,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; TransitRegionStateProcedure table=GrouptestMultiTableMoveB, region=aaa5d1563f01bc28d422b03a342188f0, UNASSIGN in 169 msec 2023-07-18 18:14:48,491 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"GrouptestMultiTableMoveB","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704088491"}]},"ts":"1689704088491"} 2023-07-18 18:14:48,492 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=GrouptestMultiTableMoveB, state=DISABLED in hbase:meta 2023-07-18 18:14:48,494 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set GrouptestMultiTableMoveB to state=DISABLED 2023-07-18 18:14:48,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; DisableTableProcedure table=GrouptestMultiTableMoveB in 188 msec 2023-07-18 18:14:48,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=113 2023-07-18 18:14:48,614 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:GrouptestMultiTableMoveB, procId: 113 completed 2023-07-18 18:14:48,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete GrouptestMultiTableMoveB 2023-07-18 18:14:48,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=GrouptestMultiTableMoveB 2023-07-18 18:14:48,618 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=116, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveB 2023-07-18 18:14:48,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint(577): Removing deleted table 'GrouptestMultiTableMoveB' from rsgroup 'Group_testMultiTableMove_1813991631' 2023-07-18 18:14:48,619 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=116, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveB 2023-07-18 18:14:48,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,626 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:48,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:48,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:48,629 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/recovered.edits] 2023-07-18 18:14:48,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-18 18:14:48,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/recovered.edits/7.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0/recovered.edits/7.seqid 2023-07-18 18:14:48,638 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/GrouptestMultiTableMoveB/aaa5d1563f01bc28d422b03a342188f0 2023-07-18 18:14:48,638 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived GrouptestMultiTableMoveB regions 2023-07-18 18:14:48,641 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=116, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveB 2023-07-18 18:14:48,645 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of GrouptestMultiTableMoveB from hbase:meta 2023-07-18 18:14:48,653 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'GrouptestMultiTableMoveB' descriptor. 2023-07-18 18:14:48,655 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=116, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveB 2023-07-18 18:14:48,655 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'GrouptestMultiTableMoveB' from region states. 2023-07-18 18:14:48,655 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704088655"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:48,659 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 18:14:48,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aaa5d1563f01bc28d422b03a342188f0, NAME => 'GrouptestMultiTableMoveB,,1689704086215.aaa5d1563f01bc28d422b03a342188f0.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 18:14:48,660 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'GrouptestMultiTableMoveB' as deleted. 2023-07-18 18:14:48,660 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"GrouptestMultiTableMoveB","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689704088660"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:48,663 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table GrouptestMultiTableMoveB state from META 2023-07-18 18:14:48,666 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=116, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=GrouptestMultiTableMoveB 2023-07-18 18:14:48,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; DeleteTableProcedure table=GrouptestMultiTableMoveB in 51 msec 2023-07-18 18:14:48,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-07-18 18:14:48,732 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:GrouptestMultiTableMoveB, procId: 116 completed 2023-07-18 18:14:48,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:48,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:48,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:48,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:48,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:48,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:48,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:48,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 5 2023-07-18 18:14:48,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:48,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:48,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:48,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:48,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:36811] to rsgroup default 2023-07-18 18:14:48,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testMultiTableMove_1813991631 2023-07-18 18:14:48,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:48,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group Group_testMultiTableMove_1813991631, current retry=0 2023-07-18 18:14:48,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850] are moved back to Group_testMultiTableMove_1813991631 2023-07-18 18:14:48,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: Group_testMultiTableMove_1813991631 => default 2023-07-18 18:14:48,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:48,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup Group_testMultiTableMove_1813991631 2023-07-18 18:14:48,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:48,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:48,790 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:48,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:48,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:48,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:48,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:48,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:48,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 509 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705288809, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:48,810 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:48,812 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:48,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,813 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:48,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:48,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:48,839 INFO [Listener at localhost/35951] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testMultiTableMove Thread=518 (was 526), OpenFileDescriptor=827 (was 841), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=437 (was 437), ProcessCount=173 (was 173), AvailableMemoryMB=3087 (was 3214) 2023-07-18 18:14:48,839 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=518 is superior to 500 2023-07-18 18:14:48,855 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testRenameRSGroupConstraints Thread=518, OpenFileDescriptor=827, MaxFileDescriptor=60000, SystemLoadAverage=437, ProcessCount=173, AvailableMemoryMB=3086 2023-07-18 18:14:48,855 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=518 is superior to 500 2023-07-18 18:14:48,856 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testRenameRSGroupConstraints 2023-07-18 18:14:48,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:48,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:48,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:48,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:48,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:48,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:48,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:48,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:48,874 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:48,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:48,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:48,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:48,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:48,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:48,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 537 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705288889, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:48,890 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:48,892 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:48,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,893 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:48,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:48,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:48,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:48,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:48,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup oldGroup 2023-07-18 18:14:48,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldGroup 2023-07-18 18:14:48,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:48,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:48,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811] to rsgroup oldGroup 2023-07-18 18:14:48,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldGroup 2023-07-18 18:14:48,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:48,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group default, current retry=0 2023-07-18 18:14:48,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417] are moved back to default 2023-07-18 18:14:48,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: default => oldGroup 2023-07-18 18:14:48,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:48,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=oldGroup 2023-07-18 18:14:48,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:48,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=oldGroup 2023-07-18 18:14:48,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:48,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:48,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:48,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup anotherRSGroup 2023-07-18 18:14:48,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/anotherRSGroup 2023-07-18 18:14:48,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldGroup 2023-07-18 18:14:48,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:48,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:48,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:46365] to rsgroup anotherRSGroup 2023-07-18 18:14:48,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/anotherRSGroup 2023-07-18 18:14:48,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldGroup 2023-07-18 18:14:48,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:48,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group default, current retry=0 2023-07-18 18:14:48,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,46365,1689704073486] are moved back to default 2023-07-18 18:14:48,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: default => anotherRSGroup 2023-07-18 18:14:48,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:48,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=anotherRSGroup 2023-07-18 18:14:48,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:48,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=anotherRSGroup 2023-07-18 18:14:48,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:48,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(408): Client=jenkins//172.31.14.131 rename rsgroup from nonExistingRSGroup to newRSGroup1 2023-07-18 18:14:48,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup nonExistingRSGroup does not exist at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.renameRSGroup(RSGroupInfoManagerImpl.java:407) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.renameRSGroup(RSGroupAdminServer.java:617) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.renameRSGroup(RSGroupAdminEndpoint.java:417) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16233) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:48,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 571 service: MasterService methodName: ExecMasterService size: 113 connection: 172.31.14.131:58898 deadline: 1689705288946, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup nonExistingRSGroup does not exist 2023-07-18 18:14:48,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(408): Client=jenkins//172.31.14.131 rename rsgroup from oldGroup to anotherRSGroup 2023-07-18 18:14:48,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Group already exists: anotherRSGroup at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.renameRSGroup(RSGroupInfoManagerImpl.java:410) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.renameRSGroup(RSGroupAdminServer.java:617) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.renameRSGroup(RSGroupAdminEndpoint.java:417) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16233) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:48,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 573 service: MasterService methodName: ExecMasterService size: 106 connection: 172.31.14.131:58898 deadline: 1689705288949, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Group already exists: anotherRSGroup 2023-07-18 18:14:48,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(408): Client=jenkins//172.31.14.131 rename rsgroup from default to newRSGroup2 2023-07-18 18:14:48,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Can't rename default rsgroup at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.renameRSGroup(RSGroupInfoManagerImpl.java:403) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.renameRSGroup(RSGroupAdminServer.java:617) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.renameRSGroup(RSGroupAdminEndpoint.java:417) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16233) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:48,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 575 service: MasterService methodName: ExecMasterService size: 102 connection: 172.31.14.131:58898 deadline: 1689705288950, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Can't rename default rsgroup 2023-07-18 18:14:48,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(408): Client=jenkins//172.31.14.131 rename rsgroup from oldGroup to default 2023-07-18 18:14:48,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Group already exists: default at org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl.renameRSGroup(RSGroupInfoManagerImpl.java:410) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.renameRSGroup(RSGroupAdminServer.java:617) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.renameRSGroup(RSGroupAdminEndpoint.java:417) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16233) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:48,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 577 service: MasterService methodName: ExecMasterService size: 99 connection: 172.31.14.131:58898 deadline: 1689705288951, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Group already exists: default 2023-07-18 18:14:48,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:48,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:48,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:48,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:48,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:48,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:46365] to rsgroup default 2023-07-18 18:14:48,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/anotherRSGroup 2023-07-18 18:14:48,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldGroup 2023-07-18 18:14:48,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:48,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group anotherRSGroup, current retry=0 2023-07-18 18:14:48,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,46365,1689704073486] are moved back to anotherRSGroup 2023-07-18 18:14:48,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: anotherRSGroup => default 2023-07-18 18:14:48,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:48,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup anotherRSGroup 2023-07-18 18:14:48,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldGroup 2023-07-18 18:14:48,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 7 2023-07-18 18:14:48,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:48,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:48,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:48,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:48,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811] to rsgroup default 2023-07-18 18:14:48,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldGroup 2023-07-18 18:14:48,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:48,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group oldGroup, current retry=0 2023-07-18 18:14:48,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417] are moved back to oldGroup 2023-07-18 18:14:48,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: oldGroup => default 2023-07-18 18:14:48,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:48,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup oldGroup 2023-07-18 18:14:48,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:48,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 5 2023-07-18 18:14:48,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:48,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:48,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:48,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:48,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:48,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:48,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:48,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:48,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:49,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:49,005 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:49,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:49,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:49,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:49,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:49,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:49,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:49,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:49,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:49,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:49,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 613 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705289015, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:49,016 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:49,018 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:49,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:49,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:49,019 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:49,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:49,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:49,041 INFO [Listener at localhost/35951] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testRenameRSGroupConstraints Thread=522 (was 518) Potentially hanging thread: hconnection-0x120ad869-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=827 (was 827), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=437 (was 437), ProcessCount=173 (was 173), AvailableMemoryMB=3074 (was 3086) 2023-07-18 18:14:49,041 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=522 is superior to 500 2023-07-18 18:14:49,061 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testRenameRSGroup Thread=522, OpenFileDescriptor=827, MaxFileDescriptor=60000, SystemLoadAverage=437, ProcessCount=173, AvailableMemoryMB=3071 2023-07-18 18:14:49,061 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=522 is superior to 500 2023-07-18 18:14:49,061 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testRenameRSGroup 2023-07-18 18:14:49,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:49,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:49,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:49,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:49,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:49,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:49,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:49,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:49,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:49,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:49,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:49,076 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:49,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:49,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:49,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:49,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:49,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:49,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:49,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:49,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 641 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705289093, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:49,093 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:49,095 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:49,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:49,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:49,096 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:49,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:49,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:49,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:49,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:49,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup oldgroup 2023-07-18 18:14:49,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldgroup 2023-07-18 18:14:49,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:49,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:49,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:49,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:49,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:49,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:49,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811] to rsgroup oldgroup 2023-07-18 18:14:49,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldgroup 2023-07-18 18:14:49,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:49,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:49,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:49,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group default, current retry=0 2023-07-18 18:14:49,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417] are moved back to default 2023-07-18 18:14:49,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: default => oldgroup 2023-07-18 18:14:49,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:49,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:49,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:49,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=oldgroup 2023-07-18 18:14:49,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:49,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRename', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'tr', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:49,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=117, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRename 2023-07-18 18:14:49,131 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=117, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRename execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:49,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRename" procId is: 117 2023-07-18 18:14:49,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=117 2023-07-18 18:14:49,134 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldgroup 2023-07-18 18:14:49,135 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:49,140 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:49,141 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:49,144 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=117, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRename execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:49,155 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,156 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 empty. 2023-07-18 18:14:49,157 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,157 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testRename regions 2023-07-18 18:14:49,194 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/testRename/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:49,196 INFO [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3d5e3e0b3f18fd5a1a661dced24485a1, NAME => 'testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRename', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'tr', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:49,215 DEBUG [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(866): Instantiated testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:49,215 DEBUG [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(1604): Closing 3d5e3e0b3f18fd5a1a661dced24485a1, disabling compactions & flushes 2023-07-18 18:14:49,215 INFO [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(1626): Closing region testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,215 DEBUG [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,215 DEBUG [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(1714): Acquired close lock on testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. after waiting 0 ms 2023-07-18 18:14:49,215 DEBUG [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(1724): Updates disabled for region testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,215 INFO [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(1838): Closed testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,215 DEBUG [RegionOpenAndInit-testRename-pool-0] regionserver.HRegion(1558): Region close journal for 3d5e3e0b3f18fd5a1a661dced24485a1: 2023-07-18 18:14:49,218 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=117, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRename execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:49,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704089219"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704089219"}]},"ts":"1689704089219"} 2023-07-18 18:14:49,220 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:14:49,221 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=117, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRename execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:49,221 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRename","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704089221"}]},"ts":"1689704089221"} 2023-07-18 18:14:49,222 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testRename, state=ENABLING in hbase:meta 2023-07-18 18:14:49,227 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:49,227 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:49,227 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:49,227 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:49,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=117, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, ASSIGN}] 2023-07-18 18:14:49,229 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=117, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, ASSIGN 2023-07-18 18:14:49,230 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=117, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:49,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=117 2023-07-18 18:14:49,381 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:49,382 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:49,383 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704089382"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704089382"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704089382"}]},"ts":"1689704089382"} 2023-07-18 18:14:49,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=119, ppid=118, state=RUNNABLE; OpenRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:49,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=117 2023-07-18 18:14:49,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3d5e3e0b3f18fd5a1a661dced24485a1, NAME => 'testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:49,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRename 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:49,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,550 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family tr of region 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,552 DEBUG [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/tr 2023-07-18 18:14:49,552 DEBUG [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/tr 2023-07-18 18:14:49,552 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d5e3e0b3f18fd5a1a661dced24485a1 columnFamilyName tr 2023-07-18 18:14:49,553 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] regionserver.HStore(310): Store=3d5e3e0b3f18fd5a1a661dced24485a1/tr, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:49,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:49,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3d5e3e0b3f18fd5a1a661dced24485a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11892987520, jitterRate=0.10762077569961548}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:49,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3d5e3e0b3f18fd5a1a661dced24485a1: 2023-07-18 18:14:49,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1., pid=119, masterSystemTime=1689704089545 2023-07-18 18:14:49,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:49,563 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704089563"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704089563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704089563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704089563"}]},"ts":"1689704089563"} 2023-07-18 18:14:49,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=118 2023-07-18 18:14:49,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=118, state=SUCCESS; OpenRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,46365,1689704073486 in 174 msec 2023-07-18 18:14:49,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=117 2023-07-18 18:14:49,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=117, state=SUCCESS; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, ASSIGN in 339 msec 2023-07-18 18:14:49,568 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=117, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRename execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:49,568 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRename","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704089568"}]},"ts":"1689704089568"} 2023-07-18 18:14:49,569 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRename, state=ENABLED in hbase:meta 2023-07-18 18:14:49,572 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=117, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRename execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:49,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, state=SUCCESS; CreateTableProcedure table=testRename in 444 msec 2023-07-18 18:14:49,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=117 2023-07-18 18:14:49,736 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRename, procId: 117 completed 2023-07-18 18:14:49,736 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRename get assigned. Timeout = 60000ms 2023-07-18 18:14:49,737 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:49,742 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3484): All regions for table testRename assigned to meta. Checking AM states. 2023-07-18 18:14:49,742 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:49,742 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3504): All regions for table testRename assigned. 2023-07-18 18:14:49,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [testRename] to rsgroup oldgroup 2023-07-18 18:14:49,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldgroup 2023-07-18 18:14:49,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:49,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:49,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:49,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table testRename to RSGroup oldgroup 2023-07-18 18:14:49,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region 3d5e3e0b3f18fd5a1a661dced24485a1 to RSGroup oldgroup 2023-07-18 18:14:49,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:49,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:49,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:49,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:49,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:49,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=120, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, REOPEN/MOVE 2023-07-18 18:14:49,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 1 region(s) to group oldgroup, current retry=0 2023-07-18 18:14:49,752 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=120, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, REOPEN/MOVE 2023-07-18 18:14:49,753 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=120 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:49,753 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704089753"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704089753"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704089753"}]},"ts":"1689704089753"} 2023-07-18 18:14:49,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=120, state=RUNNABLE; CloseRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:49,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3d5e3e0b3f18fd5a1a661dced24485a1, disabling compactions & flushes 2023-07-18 18:14:49,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. after waiting 0 ms 2023-07-18 18:14:49,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:49,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:49,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3d5e3e0b3f18fd5a1a661dced24485a1: 2023-07-18 18:14:49,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding 3d5e3e0b3f18fd5a1a661dced24485a1 move to jenkins-hbase4.apache.org,36811,1689704069850 record at close sequenceid=2 2023-07-18 18:14:49,919 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=120 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=CLOSED 2023-07-18 18:14:49,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:49,920 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704089919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704089919"}]},"ts":"1689704089919"} 2023-07-18 18:14:49,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=120 2023-07-18 18:14:49,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=120, state=SUCCESS; CloseRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,46365,1689704073486 in 167 msec 2023-07-18 18:14:49,924 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=120, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36811,1689704069850; forceNewPlan=false, retain=false 2023-07-18 18:14:50,074 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:50,074 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=120 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:50,074 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704090074"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704090074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704090074"}]},"ts":"1689704090074"} 2023-07-18 18:14:50,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=120, state=RUNNABLE; OpenRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:50,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:50,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3d5e3e0b3f18fd5a1a661dced24485a1, NAME => 'testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:50,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRename 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:50,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:50,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:50,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:50,238 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family tr of region 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:50,239 DEBUG [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/tr 2023-07-18 18:14:50,239 DEBUG [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/tr 2023-07-18 18:14:50,240 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d5e3e0b3f18fd5a1a661dced24485a1 columnFamilyName tr 2023-07-18 18:14:50,240 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] regionserver.HStore(310): Store=3d5e3e0b3f18fd5a1a661dced24485a1/tr, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:50,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:50,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:50,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:50,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3d5e3e0b3f18fd5a1a661dced24485a1; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11124829920, jitterRate=0.03608052432537079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:50,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3d5e3e0b3f18fd5a1a661dced24485a1: 2023-07-18 18:14:50,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1., pid=122, masterSystemTime=1689704090228 2023-07-18 18:14:50,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:50,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:50,248 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=120 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:50,248 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704090248"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704090248"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704090248"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704090248"}]},"ts":"1689704090248"} 2023-07-18 18:14:50,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=120 2023-07-18 18:14:50,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=120, state=SUCCESS; OpenRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,36811,1689704069850 in 173 msec 2023-07-18 18:14:50,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=120, state=SUCCESS; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, REOPEN/MOVE in 500 msec 2023-07-18 18:14:50,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=120 2023-07-18 18:14:50,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [testRename] moved to target group oldgroup. 2023-07-18 18:14:50,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:50,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:50,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:50,757 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [1,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:50,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=testRename 2023-07-18 18:14:50,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:50,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=oldgroup 2023-07-18 18:14:50,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:50,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=testRename 2023-07-18 18:14:50,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:50,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:50,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:50,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup normal 2023-07-18 18:14:50,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldgroup 2023-07-18 18:14:50,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/normal 2023-07-18 18:14:50,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:50,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:50,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:50,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:50,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:50,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:50,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:46365] to rsgroup normal 2023-07-18 18:14:50,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldgroup 2023-07-18 18:14:50,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/normal 2023-07-18 18:14:50,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:50,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:50,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:50,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group default, current retry=0 2023-07-18 18:14:50,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,46365,1689704073486] are moved back to default 2023-07-18 18:14:50,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: default => normal 2023-07-18 18:14:50,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:50,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:50,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:50,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=normal 2023-07-18 18:14:50,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:50,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'unmovedTable', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'ut', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:50,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=unmovedTable 2023-07-18 18:14:50,792 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=123, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=unmovedTable execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:50,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "unmovedTable" procId is: 123 2023-07-18 18:14:50,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=123 2023-07-18 18:14:50,794 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldgroup 2023-07-18 18:14:50,795 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/normal 2023-07-18 18:14:50,795 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:50,795 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:50,795 DEBUG [PEWorker-5] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:50,798 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=123, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=unmovedTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:50,799 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:50,800 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 empty. 2023-07-18 18:14:50,800 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:50,800 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived unmovedTable regions 2023-07-18 18:14:50,816 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/unmovedTable/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:50,817 INFO [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => e5f0535b173f09210c6c23ff8aa93af6, NAME => 'unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='unmovedTable', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'ut', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:50,831 DEBUG [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(866): Instantiated unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:50,831 DEBUG [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(1604): Closing e5f0535b173f09210c6c23ff8aa93af6, disabling compactions & flushes 2023-07-18 18:14:50,831 INFO [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(1626): Closing region unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:50,831 DEBUG [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:50,831 DEBUG [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(1714): Acquired close lock on unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. after waiting 0 ms 2023-07-18 18:14:50,831 DEBUG [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(1724): Updates disabled for region unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:50,831 INFO [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(1838): Closed unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:50,831 DEBUG [RegionOpenAndInit-unmovedTable-pool-0] regionserver.HRegion(1558): Region close journal for e5f0535b173f09210c6c23ff8aa93af6: 2023-07-18 18:14:50,833 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=123, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=unmovedTable execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:50,834 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704090834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704090834"}]},"ts":"1689704090834"} 2023-07-18 18:14:50,835 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:14:50,836 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=123, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=unmovedTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:50,836 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"unmovedTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704090836"}]},"ts":"1689704090836"} 2023-07-18 18:14:50,837 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=unmovedTable, state=ENABLING in hbase:meta 2023-07-18 18:14:50,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=124, ppid=123, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, ASSIGN}] 2023-07-18 18:14:50,844 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=124, ppid=123, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, ASSIGN 2023-07-18 18:14:50,844 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=124, ppid=123, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:50,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=123 2023-07-18 18:14:50,996 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=124 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:50,996 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704090996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704090996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704090996"}]},"ts":"1689704090996"} 2023-07-18 18:14:50,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=125, ppid=124, state=RUNNABLE; OpenRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:51,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=123 2023-07-18 18:14:51,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e5f0535b173f09210c6c23ff8aa93af6, NAME => 'unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:51,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table unmovedTable e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:51,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,160 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family ut of region e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,162 DEBUG [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/ut 2023-07-18 18:14:51,162 DEBUG [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/ut 2023-07-18 18:14:51,163 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f0535b173f09210c6c23ff8aa93af6 columnFamilyName ut 2023-07-18 18:14:51,164 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] regionserver.HStore(310): Store=e5f0535b173f09210c6c23ff8aa93af6/ut, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:51,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:51,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e5f0535b173f09210c6c23ff8aa93af6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10497760000, jitterRate=-0.022319912910461426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:51,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e5f0535b173f09210c6c23ff8aa93af6: 2023-07-18 18:14:51,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6., pid=125, masterSystemTime=1689704091149 2023-07-18 18:14:51,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,182 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=124 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:51,182 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704091182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704091182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704091182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704091182"}]},"ts":"1689704091182"} 2023-07-18 18:14:51,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=125, resume processing ppid=124 2023-07-18 18:14:51,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=125, ppid=124, state=SUCCESS; OpenRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46845,1689704069644 in 186 msec 2023-07-18 18:14:51,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=124, resume processing ppid=123 2023-07-18 18:14:51,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=124, ppid=123, state=SUCCESS; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, ASSIGN in 345 msec 2023-07-18 18:14:51,189 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=123, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=unmovedTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:51,189 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"unmovedTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704091189"}]},"ts":"1689704091189"} 2023-07-18 18:14:51,191 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=unmovedTable, state=ENABLED in hbase:meta 2023-07-18 18:14:51,194 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=123, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=unmovedTable execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:51,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; CreateTableProcedure table=unmovedTable in 405 msec 2023-07-18 18:14:51,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=123 2023-07-18 18:14:51,397 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:unmovedTable, procId: 123 completed 2023-07-18 18:14:51,397 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(3430): Waiting until all regions of table unmovedTable get assigned. Timeout = 60000ms 2023-07-18 18:14:51,397 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:51,401 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3484): All regions for table unmovedTable assigned to meta. Checking AM states. 2023-07-18 18:14:51,401 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:51,401 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3504): All regions for table unmovedTable assigned. 2023-07-18 18:14:51,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [unmovedTable] to rsgroup normal 2023-07-18 18:14:51,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/oldgroup 2023-07-18 18:14:51,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/normal 2023-07-18 18:14:51,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:51,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:51,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:51,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table unmovedTable to RSGroup normal 2023-07-18 18:14:51,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region e5f0535b173f09210c6c23ff8aa93af6 to RSGroup normal 2023-07-18 18:14:51,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=126, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, REOPEN/MOVE 2023-07-18 18:14:51,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 1 region(s) to group normal, current retry=0 2023-07-18 18:14:51,410 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=126, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, REOPEN/MOVE 2023-07-18 18:14:51,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=126 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:51,410 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704091410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704091410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704091410"}]},"ts":"1689704091410"} 2023-07-18 18:14:51,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=127, ppid=126, state=RUNNABLE; CloseRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:51,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e5f0535b173f09210c6c23ff8aa93af6, disabling compactions & flushes 2023-07-18 18:14:51,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. after waiting 0 ms 2023-07-18 18:14:51,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:51,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e5f0535b173f09210c6c23ff8aa93af6: 2023-07-18 18:14:51,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding e5f0535b173f09210c6c23ff8aa93af6 move to jenkins-hbase4.apache.org,46365,1689704073486 record at close sequenceid=2 2023-07-18 18:14:51,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,573 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=126 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=CLOSED 2023-07-18 18:14:51,573 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704091573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704091573"}]},"ts":"1689704091573"} 2023-07-18 18:14:51,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=127, resume processing ppid=126 2023-07-18 18:14:51,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=127, ppid=126, state=SUCCESS; CloseRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46845,1689704069644 in 163 msec 2023-07-18 18:14:51,577 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=126, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:51,727 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=126 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:51,728 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704091727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704091727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704091727"}]},"ts":"1689704091727"} 2023-07-18 18:14:51,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=128, ppid=126, state=RUNNABLE; OpenRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:51,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e5f0535b173f09210c6c23ff8aa93af6, NAME => 'unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:51,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table unmovedTable e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:51,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,886 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family ut of region e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,887 DEBUG [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/ut 2023-07-18 18:14:51,887 DEBUG [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/ut 2023-07-18 18:14:51,887 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f0535b173f09210c6c23ff8aa93af6 columnFamilyName ut 2023-07-18 18:14:51,888 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] regionserver.HStore(310): Store=e5f0535b173f09210c6c23ff8aa93af6/ut, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:51,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:51,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e5f0535b173f09210c6c23ff8aa93af6; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9722268000, jitterRate=-0.09454323351383209}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:51,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e5f0535b173f09210c6c23ff8aa93af6: 2023-07-18 18:14:51,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6., pid=128, masterSystemTime=1689704091881 2023-07-18 18:14:51,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:51,895 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=126 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:51,896 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704091895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704091895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704091895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704091895"}]},"ts":"1689704091895"} 2023-07-18 18:14:51,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=128, resume processing ppid=126 2023-07-18 18:14:51,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=128, ppid=126, state=SUCCESS; OpenRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46365,1689704073486 in 168 msec 2023-07-18 18:14:51,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=126, state=SUCCESS; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, REOPEN/MOVE in 489 msec 2023-07-18 18:14:52,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=126 2023-07-18 18:14:52,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [unmovedTable] moved to target group normal. 2023-07-18 18:14:52,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:52,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:52,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:52,418 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [1,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:52,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=unmovedTable 2023-07-18 18:14:52,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:52,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=normal 2023-07-18 18:14:52,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:52,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=unmovedTable 2023-07-18 18:14:52,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:52,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(408): Client=jenkins//172.31.14.131 rename rsgroup from oldgroup to newgroup 2023-07-18 18:14:52,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/normal 2023-07-18 18:14:52,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:52,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:52,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/newgroup 2023-07-18 18:14:52,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 9 2023-07-18 18:14:52,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RenameRSGroup 2023-07-18 18:14:52,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:52,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:52,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=newgroup 2023-07-18 18:14:52,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:52,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=testRename 2023-07-18 18:14:52,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:52,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=unmovedTable 2023-07-18 18:14:52,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:52,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:52,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:52,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [unmovedTable] to rsgroup default 2023-07-18 18:14:52,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/normal 2023-07-18 18:14:52,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:52,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:52,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/newgroup 2023-07-18 18:14:52,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:52,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table unmovedTable to RSGroup default 2023-07-18 18:14:52,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region e5f0535b173f09210c6c23ff8aa93af6 to RSGroup default 2023-07-18 18:14:52,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=129, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, REOPEN/MOVE 2023-07-18 18:14:52,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 1 region(s) to group default, current retry=0 2023-07-18 18:14:52,467 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=129, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, REOPEN/MOVE 2023-07-18 18:14:52,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=129 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:52,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704092468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704092468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704092468"}]},"ts":"1689704092468"} 2023-07-18 18:14:52,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=130, ppid=129, state=RUNNABLE; CloseRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:52,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e5f0535b173f09210c6c23ff8aa93af6, disabling compactions & flushes 2023-07-18 18:14:52,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:52,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:52,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. after waiting 0 ms 2023-07-18 18:14:52,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:52,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:52,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:52,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e5f0535b173f09210c6c23ff8aa93af6: 2023-07-18 18:14:52,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding e5f0535b173f09210c6c23ff8aa93af6 move to jenkins-hbase4.apache.org,46845,1689704069644 record at close sequenceid=5 2023-07-18 18:14:52,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,637 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=129 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=CLOSED 2023-07-18 18:14:52,637 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704092637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704092637"}]},"ts":"1689704092637"} 2023-07-18 18:14:52,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=130, resume processing ppid=129 2023-07-18 18:14:52,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=130, ppid=129, state=SUCCESS; CloseRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46365,1689704073486 in 169 msec 2023-07-18 18:14:52,647 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=129, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:52,798 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=129 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:52,798 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704092798"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704092798"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704092798"}]},"ts":"1689704092798"} 2023-07-18 18:14:52,800 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=131, ppid=129, state=RUNNABLE; OpenRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:52,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:52,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e5f0535b173f09210c6c23ff8aa93af6, NAME => 'unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:52,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table unmovedTable e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:52,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,957 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family ut of region e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,958 DEBUG [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/ut 2023-07-18 18:14:52,958 DEBUG [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/ut 2023-07-18 18:14:52,958 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5f0535b173f09210c6c23ff8aa93af6 columnFamilyName ut 2023-07-18 18:14:52,959 INFO [StoreOpener-e5f0535b173f09210c6c23ff8aa93af6-1] regionserver.HStore(310): Store=e5f0535b173f09210c6c23ff8aa93af6/ut, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:52,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:52,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e5f0535b173f09210c6c23ff8aa93af6; next sequenceid=8; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9931173120, jitterRate=-0.07508742809295654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:52,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e5f0535b173f09210c6c23ff8aa93af6: 2023-07-18 18:14:52,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6., pid=131, masterSystemTime=1689704092951 2023-07-18 18:14:52,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:52,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:52,967 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=129 updating hbase:meta row=e5f0535b173f09210c6c23ff8aa93af6, regionState=OPEN, openSeqNum=8, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:52,967 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6.","families":{"info":[{"qualifier":"regioninfo","vlen":46,"tag":[],"timestamp":"1689704092967"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704092967"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704092967"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704092967"}]},"ts":"1689704092967"} 2023-07-18 18:14:52,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=131, resume processing ppid=129 2023-07-18 18:14:52,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=131, ppid=129, state=SUCCESS; OpenRegionProcedure e5f0535b173f09210c6c23ff8aa93af6, server=jenkins-hbase4.apache.org,46845,1689704069644 in 168 msec 2023-07-18 18:14:52,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=129, state=SUCCESS; TransitRegionStateProcedure table=unmovedTable, region=e5f0535b173f09210c6c23ff8aa93af6, REOPEN/MOVE in 504 msec 2023-07-18 18:14:53,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=129 2023-07-18 18:14:53,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [unmovedTable] moved to target group default. 2023-07-18 18:14:53,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:53,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:46365] to rsgroup default 2023-07-18 18:14:53,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/normal 2023-07-18 18:14:53,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:53,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:53,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/newgroup 2023-07-18 18:14:53,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:14:53,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group normal, current retry=0 2023-07-18 18:14:53,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,46365,1689704073486] are moved back to normal 2023-07-18 18:14:53,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: normal => default 2023-07-18 18:14:53,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:53,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup normal 2023-07-18 18:14:53,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:53,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:53,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/newgroup 2023-07-18 18:14:53,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 7 2023-07-18 18:14:53,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:53,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:53,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:53,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:53,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:53,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:53,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:53,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:53,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/newgroup 2023-07-18 18:14:53,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 5 2023-07-18 18:14:53,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:53,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [testRename] to rsgroup default 2023-07-18 18:14:53,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:53,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/newgroup 2023-07-18 18:14:53,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:53,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(339): Moving region(s) for table testRename to RSGroup default 2023-07-18 18:14:53,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(345): Moving region 3d5e3e0b3f18fd5a1a661dced24485a1 to RSGroup default 2023-07-18 18:14:53,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=132, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, REOPEN/MOVE 2023-07-18 18:14:53,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 1 region(s) to group default, current retry=0 2023-07-18 18:14:53,507 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=132, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, REOPEN/MOVE 2023-07-18 18:14:53,508 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=132 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:53,508 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704093508"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704093508"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704093508"}]},"ts":"1689704093508"} 2023-07-18 18:14:53,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=133, ppid=132, state=RUNNABLE; CloseRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,36811,1689704069850}] 2023-07-18 18:14:53,559 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-18 18:14:53,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:53,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3d5e3e0b3f18fd5a1a661dced24485a1, disabling compactions & flushes 2023-07-18 18:14:53,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:53,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:53,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. after waiting 0 ms 2023-07-18 18:14:53,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:53,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-18 18:14:53,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:53,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3d5e3e0b3f18fd5a1a661dced24485a1: 2023-07-18 18:14:53,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3513): Adding 3d5e3e0b3f18fd5a1a661dced24485a1 move to jenkins-hbase4.apache.org,46365,1689704073486 record at close sequenceid=5 2023-07-18 18:14:53,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:53,683 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=132 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=CLOSED 2023-07-18 18:14:53,683 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704093683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704093683"}]},"ts":"1689704093683"} 2023-07-18 18:14:53,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=133, resume processing ppid=132 2023-07-18 18:14:53,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=133, ppid=132, state=SUCCESS; CloseRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,36811,1689704069850 in 175 msec 2023-07-18 18:14:53,693 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=132, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:53,843 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:14:53,844 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=132 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:53,844 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704093844"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704093844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704093844"}]},"ts":"1689704093844"} 2023-07-18 18:14:53,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=134, ppid=132, state=RUNNABLE; OpenRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:54,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:54,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3d5e3e0b3f18fd5a1a661dced24485a1, NAME => 'testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:54,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRename 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:54,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:54,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:54,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:54,004 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family tr of region 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:54,005 DEBUG [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/tr 2023-07-18 18:14:54,005 DEBUG [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/tr 2023-07-18 18:14:54,005 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d5e3e0b3f18fd5a1a661dced24485a1 columnFamilyName tr 2023-07-18 18:14:54,006 INFO [StoreOpener-3d5e3e0b3f18fd5a1a661dced24485a1-1] regionserver.HStore(310): Store=3d5e3e0b3f18fd5a1a661dced24485a1/tr, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:54,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:54,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:54,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:54,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3d5e3e0b3f18fd5a1a661dced24485a1; next sequenceid=8; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11175279360, jitterRate=0.0407789945602417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:54,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3d5e3e0b3f18fd5a1a661dced24485a1: 2023-07-18 18:14:54,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1., pid=134, masterSystemTime=1689704093998 2023-07-18 18:14:54,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:54,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:54,014 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=132 updating hbase:meta row=3d5e3e0b3f18fd5a1a661dced24485a1, regionState=OPEN, openSeqNum=8, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:54,014 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.","families":{"info":[{"qualifier":"regioninfo","vlen":44,"tag":[],"timestamp":"1689704094014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704094014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704094014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704094014"}]},"ts":"1689704094014"} 2023-07-18 18:14:54,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=134, resume processing ppid=132 2023-07-18 18:14:54,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=134, ppid=132, state=SUCCESS; OpenRegionProcedure 3d5e3e0b3f18fd5a1a661dced24485a1, server=jenkins-hbase4.apache.org,46365,1689704073486 in 169 msec 2023-07-18 18:14:54,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=132, state=SUCCESS; TransitRegionStateProcedure table=testRename, region=3d5e3e0b3f18fd5a1a661dced24485a1, REOPEN/MOVE in 510 msec 2023-07-18 18:14:54,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure.ProcedureSyncWait(216): waitFor pid=132 2023-07-18 18:14:54,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [testRename] moved to target group default. 2023-07-18 18:14:54,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:54,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811] to rsgroup default 2023-07-18 18:14:54,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/newgroup 2023-07-18 18:14:54,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:54,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group newgroup, current retry=0 2023-07-18 18:14:54,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417] are moved back to newgroup 2023-07-18 18:14:54,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: newgroup => default 2023-07-18 18:14:54,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:54,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup newgroup 2023-07-18 18:14:54,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:54,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:54,529 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:54,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:54,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:54,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:54,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:54,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:54,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:54,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 761 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705294540, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:54,541 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:54,542 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:54,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,543 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, unmovedTable, hbase:rsgroup, testRename], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:54,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:54,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:54,564 INFO [Listener at localhost/35951] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testRenameRSGroup Thread=517 (was 522), OpenFileDescriptor=821 (was 827), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=432 (was 437), ProcessCount=173 (was 173), AvailableMemoryMB=2982 (was 3071) 2023-07-18 18:14:54,564 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=517 is superior to 500 2023-07-18 18:14:54,585 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testBogusArgs Thread=517, OpenFileDescriptor=821, MaxFileDescriptor=60000, SystemLoadAverage=432, ProcessCount=173, AvailableMemoryMB=2981 2023-07-18 18:14:54,586 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=517 is superior to 500 2023-07-18 18:14:54,586 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testBogusArgs 2023-07-18 18:14:54,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:54,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:54,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:54,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:54,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:54,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:54,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:54,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:54,602 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:54,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:54,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:54,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:54,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:54,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:54,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:54,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 789 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705294612, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:54,613 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:54,615 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:54,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,616 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, unmovedTable, hbase:rsgroup, testRename], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:54,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:54,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:54,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=nonexistent 2023-07-18 18:14:54,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:54,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(334): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, server=bogus:123 2023-07-18 18:14:54,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfServer 2023-07-18 18:14:54,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=bogus 2023-07-18 18:14:54,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:54,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup bogus 2023-07-18 18:14:54,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup bogus does not exist at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.removeRSGroup(RSGroupAdminServer.java:486) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.removeRSGroup(RSGroupAdminEndpoint.java:278) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16208) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:54,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 801 service: MasterService methodName: ExecMasterService size: 87 connection: 172.31.14.131:58898 deadline: 1689705294624, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup bogus does not exist 2023-07-18 18:14:54,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [bogus:123] to rsgroup bogus 2023-07-18 18:14:54,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup does not exist: bogus at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.getAndCheckRSGroupInfo(RSGroupAdminServer.java:115) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:398) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:54,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 804 service: MasterService methodName: ExecMasterService size: 96 connection: 172.31.14.131:58898 deadline: 1689705294626, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup does not exist: bogus 2023-07-18 18:14:54,628 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-18 18:14:54,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(492): Client=jenkins//172.31.14.131 set balanceSwitch=true 2023-07-18 18:14:54,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(292): Client=jenkins//172.31.14.131 balance rsgroup, group=bogus 2023-07-18 18:14:54,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup does not exist: bogus at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.balanceRSGroup(RSGroupAdminServer.java:523) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.balanceRSGroup(RSGroupAdminEndpoint.java:299) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16213) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:54,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 808 service: MasterService methodName: ExecMasterService size: 88 connection: 172.31.14.131:58898 deadline: 1689705294632, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup does not exist: bogus 2023-07-18 18:14:54,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:54,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:54,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:54,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:54,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:54,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:54,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:54,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:54,645 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:54,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:54,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:54,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:54,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:54,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:54,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:54,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 832 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705294655, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:54,659 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:54,660 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:54,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,661 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, unmovedTable, hbase:rsgroup, testRename], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:54,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:54,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:54,680 INFO [Listener at localhost/35951] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testBogusArgs Thread=521 (was 517) Potentially hanging thread: hconnection-0x120ad869-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x71c9d8c-shared-pool-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=821 (was 821), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=432 (was 432), ProcessCount=173 (was 173), AvailableMemoryMB=2981 (was 2981) 2023-07-18 18:14:54,680 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=521 is superior to 500 2023-07-18 18:14:54,701 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testDisabledTableMove Thread=521, OpenFileDescriptor=821, MaxFileDescriptor=60000, SystemLoadAverage=432, ProcessCount=173, AvailableMemoryMB=2980 2023-07-18 18:14:54,701 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=521 is superior to 500 2023-07-18 18:14:54,701 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testDisabledTableMove 2023-07-18 18:14:54,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:54,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:54,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:54,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:54,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:54,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:54,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:54,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:54,718 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:54,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:54,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:54,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:54,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:54,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:54,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:54,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 860 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705294737, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:54,738 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:54,740 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:54,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,741 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, unmovedTable, hbase:rsgroup, testRename], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:54,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:54,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:54,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:54,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:54,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup Group_testDisabledTableMove_1264411243 2023-07-18 18:14:54,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testDisabledTableMove_1264411243 2023-07-18 18:14:54,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:54,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:54,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:54,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811] to rsgroup Group_testDisabledTableMove_1264411243 2023-07-18 18:14:54,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testDisabledTableMove_1264411243 2023-07-18 18:14:54,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:54,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:54,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group default, current retry=0 2023-07-18 18:14:54,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417] are moved back to default 2023-07-18 18:14:54,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: default => Group_testDisabledTableMove_1264411243 2023-07-18 18:14:54,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:54,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:54,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:54,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=Group_testDisabledTableMove_1264411243 2023-07-18 18:14:54,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:54,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'Group_testDisabledTableMove', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:54,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=135, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=Group_testDisabledTableMove 2023-07-18 18:14:54,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=Group_testDisabledTableMove execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:54,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "Group_testDisabledTableMove" procId is: 135 2023-07-18 18:14:54,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=135 2023-07-18 18:14:54,770 DEBUG [PEWorker-4] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:54,771 DEBUG [PEWorker-4] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testDisabledTableMove_1264411243 2023-07-18 18:14:54,771 DEBUG [PEWorker-4] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:54,771 DEBUG [PEWorker-4] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:54,774 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=Group_testDisabledTableMove execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:54,779 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:54,779 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:54,779 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:54,779 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:54,779 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:54,780 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d empty. 2023-07-18 18:14:54,780 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49 empty. 2023-07-18 18:14:54,780 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e empty. 2023-07-18 18:14:54,780 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365 empty. 2023-07-18 18:14:54,780 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917 empty. 2023-07-18 18:14:54,780 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:54,781 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:54,781 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:54,781 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:54,781 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:54,781 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived Group_testDisabledTableMove regions 2023-07-18 18:14:54,794 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:54,795 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(7675): creating {ENCODED => b6b580baa8178fda576f8c8c29b5ed5d, NAME => 'Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.', STARTKEY => '', ENDKEY => 'aaaaa'}, tableDescriptor='Group_testDisabledTableMove', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:54,797 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(7675): creating {ENCODED => 98442a6390f9223fa54a692a0d768917, NAME => 'Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'}, tableDescriptor='Group_testDisabledTableMove', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:54,797 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(7675): creating {ENCODED => abe9745646de8ef0884e7a2af1135a49, NAME => 'Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'}, tableDescriptor='Group_testDisabledTableMove', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:54,813 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:54,813 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1604): Closing b6b580baa8178fda576f8c8c29b5ed5d, disabling compactions & flushes 2023-07-18 18:14:54,813 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:54,813 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:54,813 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. after waiting 0 ms 2023-07-18 18:14:54,813 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:54,813 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:54,813 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1558): Region close journal for b6b580baa8178fda576f8c8c29b5ed5d: 2023-07-18 18:14:54,814 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(7675): creating {ENCODED => f9cfa2e31116e572b88f7a5316d0b365, NAME => 'Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'}, tableDescriptor='Group_testDisabledTableMove', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:54,814 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:54,815 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1604): Closing 98442a6390f9223fa54a692a0d768917, disabling compactions & flushes 2023-07-18 18:14:54,815 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:54,815 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:54,815 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. after waiting 0 ms 2023-07-18 18:14:54,815 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:54,815 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:54,815 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1558): Region close journal for 98442a6390f9223fa54a692a0d768917: 2023-07-18 18:14:54,815 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1e80e9bee6a883428fd8b5c249beaa5e, NAME => 'Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.', STARTKEY => 'zzzzz', ENDKEY => ''}, tableDescriptor='Group_testDisabledTableMove', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp 2023-07-18 18:14:54,821 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:54,821 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(1604): Closing abe9745646de8ef0884e7a2af1135a49, disabling compactions & flushes 2023-07-18 18:14:54,821 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:54,821 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:54,821 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. after waiting 0 ms 2023-07-18 18:14:54,821 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:54,821 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:54,821 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-2] regionserver.HRegion(1558): Region close journal for abe9745646de8ef0884e7a2af1135a49: 2023-07-18 18:14:54,828 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:54,829 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1604): Closing f9cfa2e31116e572b88f7a5316d0b365, disabling compactions & flushes 2023-07-18 18:14:54,829 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:54,829 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:54,829 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. after waiting 0 ms 2023-07-18 18:14:54,829 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:54,829 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:54,829 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-0] regionserver.HRegion(1558): Region close journal for f9cfa2e31116e572b88f7a5316d0b365: 2023-07-18 18:14:54,829 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:54,830 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1604): Closing 1e80e9bee6a883428fd8b5c249beaa5e, disabling compactions & flushes 2023-07-18 18:14:54,830 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:54,830 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:54,830 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. after waiting 0 ms 2023-07-18 18:14:54,830 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:54,830 INFO [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:54,830 DEBUG [RegionOpenAndInit-Group_testDisabledTableMove-pool-1] regionserver.HRegion(1558): Region close journal for 1e80e9bee6a883428fd8b5c249beaa5e: 2023-07-18 18:14:54,833 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=Group_testDisabledTableMove execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:54,837 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704094836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704094836"}]},"ts":"1689704094836"} 2023-07-18 18:14:54,837 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704094836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704094836"}]},"ts":"1689704094836"} 2023-07-18 18:14:54,837 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,i\\xBF\\x14i\\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704094836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704094836"}]},"ts":"1689704094836"} 2023-07-18 18:14:54,837 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,r\\x1C\\xC7r\\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704094836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704094836"}]},"ts":"1689704094836"} 2023-07-18 18:14:54,837 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704094836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704094836"}]},"ts":"1689704094836"} 2023-07-18 18:14:54,839 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 5 regions to meta. 2023-07-18 18:14:54,840 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=Group_testDisabledTableMove execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:54,840 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testDisabledTableMove","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704094840"}]},"ts":"1689704094840"} 2023-07-18 18:14:54,842 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=Group_testDisabledTableMove, state=ENABLING in hbase:meta 2023-07-18 18:14:54,847 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:54,848 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:54,848 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:54,848 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:54,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=136, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=b6b580baa8178fda576f8c8c29b5ed5d, ASSIGN}, {pid=137, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=98442a6390f9223fa54a692a0d768917, ASSIGN}, {pid=138, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=abe9745646de8ef0884e7a2af1135a49, ASSIGN}, {pid=139, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=f9cfa2e31116e572b88f7a5316d0b365, ASSIGN}, {pid=140, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=1e80e9bee6a883428fd8b5c249beaa5e, ASSIGN}] 2023-07-18 18:14:54,852 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=140, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=1e80e9bee6a883428fd8b5c249beaa5e, ASSIGN 2023-07-18 18:14:54,852 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=138, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=abe9745646de8ef0884e7a2af1135a49, ASSIGN 2023-07-18 18:14:54,853 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=137, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=98442a6390f9223fa54a692a0d768917, ASSIGN 2023-07-18 18:14:54,853 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=136, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=b6b580baa8178fda576f8c8c29b5ed5d, ASSIGN 2023-07-18 18:14:54,854 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=139, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=f9cfa2e31116e572b88f7a5316d0b365, ASSIGN 2023-07-18 18:14:54,854 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=140, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=1e80e9bee6a883428fd8b5c249beaa5e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:54,854 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=137, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=98442a6390f9223fa54a692a0d768917, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:54,854 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=136, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=b6b580baa8178fda576f8c8c29b5ed5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:54,855 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=138, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=abe9745646de8ef0884e7a2af1135a49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46845,1689704069644; forceNewPlan=false, retain=false 2023-07-18 18:14:54,856 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=139, ppid=135, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=f9cfa2e31116e572b88f7a5316d0b365, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46365,1689704073486; forceNewPlan=false, retain=false 2023-07-18 18:14:54,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=135 2023-07-18 18:14:55,004 INFO [jenkins-hbase4:43777] balancer.BaseLoadBalancer(1545): Reassigned 5 regions. 5 retained the pre-restart assignment. 2023-07-18 18:14:55,009 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=137 updating hbase:meta row=98442a6390f9223fa54a692a0d768917, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:55,009 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=138 updating hbase:meta row=abe9745646de8ef0884e7a2af1135a49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=139 updating hbase:meta row=f9cfa2e31116e572b88f7a5316d0b365, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:55,009 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=140 updating hbase:meta row=1e80e9bee6a883428fd8b5c249beaa5e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,009 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=136 updating hbase:meta row=b6b580baa8178fda576f8c8c29b5ed5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,009 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704095008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095008"}]},"ts":"1689704095008"} 2023-07-18 18:14:55,009 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704095009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095009"}]},"ts":"1689704095009"} 2023-07-18 18:14:55,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,r\\x1C\\xC7r\\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095009"}]},"ts":"1689704095009"} 2023-07-18 18:14:55,009 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095009"}]},"ts":"1689704095009"} 2023-07-18 18:14:55,009 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,i\\xBF\\x14i\\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095008"}]},"ts":"1689704095008"} 2023-07-18 18:14:55,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=141, ppid=140, state=RUNNABLE; OpenRegionProcedure 1e80e9bee6a883428fd8b5c249beaa5e, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:55,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=142, ppid=139, state=RUNNABLE; OpenRegionProcedure f9cfa2e31116e572b88f7a5316d0b365, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:55,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=143, ppid=136, state=RUNNABLE; OpenRegionProcedure b6b580baa8178fda576f8c8c29b5ed5d, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:55,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=144, ppid=137, state=RUNNABLE; OpenRegionProcedure 98442a6390f9223fa54a692a0d768917, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:55,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=145, ppid=138, state=RUNNABLE; OpenRegionProcedure abe9745646de8ef0884e7a2af1135a49, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:55,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=135 2023-07-18 18:14:55,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:55,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e80e9bee6a883428fd8b5c249beaa5e, NAME => 'Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.', STARTKEY => 'zzzzz', ENDKEY => ''} 2023-07-18 18:14:55,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testDisabledTableMove 1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:55,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:55,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9cfa2e31116e572b88f7a5316d0b365, NAME => 'Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'} 2023-07-18 18:14:55,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testDisabledTableMove f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:55,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,173 INFO [StoreOpener-1e80e9bee6a883428fd8b5c249beaa5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,175 INFO [StoreOpener-f9cfa2e31116e572b88f7a5316d0b365-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,176 DEBUG [StoreOpener-1e80e9bee6a883428fd8b5c249beaa5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e/f 2023-07-18 18:14:55,176 DEBUG [StoreOpener-1e80e9bee6a883428fd8b5c249beaa5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e/f 2023-07-18 18:14:55,176 INFO [StoreOpener-1e80e9bee6a883428fd8b5c249beaa5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e80e9bee6a883428fd8b5c249beaa5e columnFamilyName f 2023-07-18 18:14:55,177 INFO [StoreOpener-1e80e9bee6a883428fd8b5c249beaa5e-1] regionserver.HStore(310): Store=1e80e9bee6a883428fd8b5c249beaa5e/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:55,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,178 DEBUG [StoreOpener-f9cfa2e31116e572b88f7a5316d0b365-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365/f 2023-07-18 18:14:55,178 DEBUG [StoreOpener-f9cfa2e31116e572b88f7a5316d0b365-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365/f 2023-07-18 18:14:55,179 INFO [StoreOpener-f9cfa2e31116e572b88f7a5316d0b365-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9cfa2e31116e572b88f7a5316d0b365 columnFamilyName f 2023-07-18 18:14:55,179 INFO [StoreOpener-f9cfa2e31116e572b88f7a5316d0b365-1] regionserver.HStore(310): Store=f9cfa2e31116e572b88f7a5316d0b365/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:55,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:55,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e80e9bee6a883428fd8b5c249beaa5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11544216320, jitterRate=0.07513892650604248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:55,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e80e9bee6a883428fd8b5c249beaa5e: 2023-07-18 18:14:55,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e., pid=141, masterSystemTime=1689704095167 2023-07-18 18:14:55,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:55,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:55,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:55,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:55,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6b580baa8178fda576f8c8c29b5ed5d, NAME => 'Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.', STARTKEY => '', ENDKEY => 'aaaaa'} 2023-07-18 18:14:55,188 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=140 updating hbase:meta row=1e80e9bee6a883428fd8b5c249beaa5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testDisabledTableMove b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,188 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704095188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704095188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704095188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704095188"}]},"ts":"1689704095188"} 2023-07-18 18:14:55,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:55,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9cfa2e31116e572b88f7a5316d0b365; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11513648640, jitterRate=0.07229208946228027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:55,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9cfa2e31116e572b88f7a5316d0b365: 2023-07-18 18:14:55,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365., pid=142, masterSystemTime=1689704095169 2023-07-18 18:14:55,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:55,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:55,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:55,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98442a6390f9223fa54a692a0d768917, NAME => 'Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'} 2023-07-18 18:14:55,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testDisabledTableMove 98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:55,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,195 INFO [StoreOpener-b6b580baa8178fda576f8c8c29b5ed5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,195 INFO [StoreOpener-98442a6390f9223fa54a692a0d768917-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region 98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,196 DEBUG [StoreOpener-98442a6390f9223fa54a692a0d768917-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917/f 2023-07-18 18:14:55,197 DEBUG [StoreOpener-98442a6390f9223fa54a692a0d768917-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917/f 2023-07-18 18:14:55,197 DEBUG [StoreOpener-b6b580baa8178fda576f8c8c29b5ed5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d/f 2023-07-18 18:14:55,197 DEBUG [StoreOpener-b6b580baa8178fda576f8c8c29b5ed5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d/f 2023-07-18 18:14:55,197 INFO [StoreOpener-98442a6390f9223fa54a692a0d768917-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98442a6390f9223fa54a692a0d768917 columnFamilyName f 2023-07-18 18:14:55,197 INFO [StoreOpener-b6b580baa8178fda576f8c8c29b5ed5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6b580baa8178fda576f8c8c29b5ed5d columnFamilyName f 2023-07-18 18:14:55,198 INFO [StoreOpener-98442a6390f9223fa54a692a0d768917-1] regionserver.HStore(310): Store=98442a6390f9223fa54a692a0d768917/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:55,198 INFO [StoreOpener-b6b580baa8178fda576f8c8c29b5ed5d-1] regionserver.HStore(310): Store=b6b580baa8178fda576f8c8c29b5ed5d/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,201 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=139 updating hbase:meta row=f9cfa2e31116e572b88f7a5316d0b365, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:55,202 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testDisabledTableMove,r\\x1C\\xC7r\\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095201"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704095201"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704095201"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704095201"}]},"ts":"1689704095201"} 2023-07-18 18:14:55,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=141, resume processing ppid=140 2023-07-18 18:14:55,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=141, ppid=140, state=SUCCESS; OpenRegionProcedure 1e80e9bee6a883428fd8b5c249beaa5e, server=jenkins-hbase4.apache.org,46845,1689704069644 in 179 msec 2023-07-18 18:14:55,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=140, ppid=135, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=1e80e9bee6a883428fd8b5c249beaa5e, ASSIGN in 354 msec 2023-07-18 18:14:55,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=142, resume processing ppid=139 2023-07-18 18:14:55,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=142, ppid=139, state=SUCCESS; OpenRegionProcedure f9cfa2e31116e572b88f7a5316d0b365, server=jenkins-hbase4.apache.org,46365,1689704073486 in 191 msec 2023-07-18 18:14:55,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:55,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=139, ppid=135, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=f9cfa2e31116e572b88f7a5316d0b365, ASSIGN in 357 msec 2023-07-18 18:14:55,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 98442a6390f9223fa54a692a0d768917; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10134887680, jitterRate=-0.056115031242370605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:55,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 98442a6390f9223fa54a692a0d768917: 2023-07-18 18:14:55,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:55,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917., pid=144, masterSystemTime=1689704095169 2023-07-18 18:14:55,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b6b580baa8178fda576f8c8c29b5ed5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10519650080, jitterRate=-0.020281240344047546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:55,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b6b580baa8178fda576f8c8c29b5ed5d: 2023-07-18 18:14:55,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d., pid=143, masterSystemTime=1689704095167 2023-07-18 18:14:55,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:55,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:55,211 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=137 updating hbase:meta row=98442a6390f9223fa54a692a0d768917, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:55,211 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095211"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704095211"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704095211"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704095211"}]},"ts":"1689704095211"} 2023-07-18 18:14:55,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:55,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:55,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:55,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => abe9745646de8ef0884e7a2af1135a49, NAME => 'Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'} 2023-07-18 18:14:55,211 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=136 updating hbase:meta row=b6b580baa8178fda576f8c8c29b5ed5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,211 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704095211"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704095211"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704095211"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704095211"}]},"ts":"1689704095211"} 2023-07-18 18:14:55,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table Group_testDisabledTableMove abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:55,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=144, resume processing ppid=137 2023-07-18 18:14:55,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=144, ppid=137, state=SUCCESS; OpenRegionProcedure 98442a6390f9223fa54a692a0d768917, server=jenkins-hbase4.apache.org,46365,1689704073486 in 199 msec 2023-07-18 18:14:55,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=143, resume processing ppid=136 2023-07-18 18:14:55,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=143, ppid=136, state=SUCCESS; OpenRegionProcedure b6b580baa8178fda576f8c8c29b5ed5d, server=jenkins-hbase4.apache.org,46845,1689704069644 in 201 msec 2023-07-18 18:14:55,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=137, ppid=135, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=98442a6390f9223fa54a692a0d768917, ASSIGN in 366 msec 2023-07-18 18:14:55,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=136, ppid=135, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=b6b580baa8178fda576f8c8c29b5ed5d, ASSIGN in 367 msec 2023-07-18 18:14:55,219 INFO [StoreOpener-abe9745646de8ef0884e7a2af1135a49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,221 DEBUG [StoreOpener-abe9745646de8ef0884e7a2af1135a49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49/f 2023-07-18 18:14:55,221 DEBUG [StoreOpener-abe9745646de8ef0884e7a2af1135a49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49/f 2023-07-18 18:14:55,221 INFO [StoreOpener-abe9745646de8ef0884e7a2af1135a49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abe9745646de8ef0884e7a2af1135a49 columnFamilyName f 2023-07-18 18:14:55,222 INFO [StoreOpener-abe9745646de8ef0884e7a2af1135a49-1] regionserver.HStore(310): Store=abe9745646de8ef0884e7a2af1135a49/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:55,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:55,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened abe9745646de8ef0884e7a2af1135a49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10540798080, jitterRate=-0.018311679363250732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:55,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for abe9745646de8ef0884e7a2af1135a49: 2023-07-18 18:14:55,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49., pid=145, masterSystemTime=1689704095167 2023-07-18 18:14:55,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:55,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:55,232 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=138 updating hbase:meta row=abe9745646de8ef0884e7a2af1135a49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,232 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"Group_testDisabledTableMove,i\\xBF\\x14i\\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095231"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704095231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704095231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704095231"}]},"ts":"1689704095231"} 2023-07-18 18:14:55,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=145, resume processing ppid=138 2023-07-18 18:14:55,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=145, ppid=138, state=SUCCESS; OpenRegionProcedure abe9745646de8ef0884e7a2af1135a49, server=jenkins-hbase4.apache.org,46845,1689704069644 in 219 msec 2023-07-18 18:14:55,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=138, resume processing ppid=135 2023-07-18 18:14:55,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=138, ppid=135, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=abe9745646de8ef0884e7a2af1135a49, ASSIGN in 387 msec 2023-07-18 18:14:55,238 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=Group_testDisabledTableMove execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:14:55,238 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testDisabledTableMove","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704095238"}]},"ts":"1689704095238"} 2023-07-18 18:14:55,239 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=Group_testDisabledTableMove, state=ENABLED in hbase:meta 2023-07-18 18:14:55,242 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=135, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=Group_testDisabledTableMove execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:14:55,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=135, state=SUCCESS; CreateTableProcedure table=Group_testDisabledTableMove in 477 msec 2023-07-18 18:14:55,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=135 2023-07-18 18:14:55,373 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:Group_testDisabledTableMove, procId: 135 completed 2023-07-18 18:14:55,373 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(3430): Waiting until all regions of table Group_testDisabledTableMove get assigned. Timeout = 60000ms 2023-07-18 18:14:55,373 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:55,377 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3484): All regions for table Group_testDisabledTableMove assigned to meta. Checking AM states. 2023-07-18 18:14:55,377 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:55,377 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(3504): All regions for table Group_testDisabledTableMove assigned. 2023-07-18 18:14:55,377 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:55,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=Group_testDisabledTableMove 2023-07-18 18:14:55,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:55,387 INFO [Listener at localhost/35951] client.HBaseAdmin$15(890): Started disable of Group_testDisabledTableMove 2023-07-18 18:14:55,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable Group_testDisabledTableMove 2023-07-18 18:14:55,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=146, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=Group_testDisabledTableMove 2023-07-18 18:14:55,392 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testDisabledTableMove","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704095392"}]},"ts":"1689704095392"} 2023-07-18 18:14:55,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=146 2023-07-18 18:14:55,394 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=Group_testDisabledTableMove, state=DISABLING in hbase:meta 2023-07-18 18:14:55,395 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set Group_testDisabledTableMove to state=DISABLING 2023-07-18 18:14:55,403 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=147, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=b6b580baa8178fda576f8c8c29b5ed5d, UNASSIGN}, {pid=148, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=98442a6390f9223fa54a692a0d768917, UNASSIGN}, {pid=149, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=abe9745646de8ef0884e7a2af1135a49, UNASSIGN}, {pid=150, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=f9cfa2e31116e572b88f7a5316d0b365, UNASSIGN}, {pid=151, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=1e80e9bee6a883428fd8b5c249beaa5e, UNASSIGN}] 2023-07-18 18:14:55,404 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=150, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=f9cfa2e31116e572b88f7a5316d0b365, UNASSIGN 2023-07-18 18:14:55,404 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=148, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=98442a6390f9223fa54a692a0d768917, UNASSIGN 2023-07-18 18:14:55,404 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=151, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=1e80e9bee6a883428fd8b5c249beaa5e, UNASSIGN 2023-07-18 18:14:55,404 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=149, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=abe9745646de8ef0884e7a2af1135a49, UNASSIGN 2023-07-18 18:14:55,404 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=147, ppid=146, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=b6b580baa8178fda576f8c8c29b5ed5d, UNASSIGN 2023-07-18 18:14:55,405 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=150 updating hbase:meta row=f9cfa2e31116e572b88f7a5316d0b365, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:55,405 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=148 updating hbase:meta row=98442a6390f9223fa54a692a0d768917, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:55,405 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,r\\x1C\\xC7r\\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095405"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095405"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095405"}]},"ts":"1689704095405"} 2023-07-18 18:14:55,405 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095405"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095405"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095405"}]},"ts":"1689704095405"} 2023-07-18 18:14:55,407 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=151 updating hbase:meta row=1e80e9bee6a883428fd8b5c249beaa5e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,407 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=149 updating hbase:meta row=abe9745646de8ef0884e7a2af1135a49, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,407 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704095407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095407"}]},"ts":"1689704095407"} 2023-07-18 18:14:55,407 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,i\\xBF\\x14i\\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095407"}]},"ts":"1689704095407"} 2023-07-18 18:14:55,408 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=153, ppid=148, state=RUNNABLE; CloseRegionProcedure 98442a6390f9223fa54a692a0d768917, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:55,407 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=147 updating hbase:meta row=b6b580baa8178fda576f8c8c29b5ed5d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=152, ppid=150, state=RUNNABLE; CloseRegionProcedure f9cfa2e31116e572b88f7a5316d0b365, server=jenkins-hbase4.apache.org,46365,1689704073486}] 2023-07-18 18:14:55,408 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704095407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704095407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704095407"}]},"ts":"1689704095407"} 2023-07-18 18:14:55,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=154, ppid=151, state=RUNNABLE; CloseRegionProcedure 1e80e9bee6a883428fd8b5c249beaa5e, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:55,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=155, ppid=149, state=RUNNABLE; CloseRegionProcedure abe9745646de8ef0884e7a2af1135a49, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:55,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=156, ppid=147, state=RUNNABLE; CloseRegionProcedure b6b580baa8178fda576f8c8c29b5ed5d, server=jenkins-hbase4.apache.org,46845,1689704069644}] 2023-07-18 18:14:55,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=146 2023-07-18 18:14:55,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9cfa2e31116e572b88f7a5316d0b365, disabling compactions & flushes 2023-07-18 18:14:55,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:55,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:55,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. after waiting 0 ms 2023-07-18 18:14:55,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:55,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing abe9745646de8ef0884e7a2af1135a49, disabling compactions & flushes 2023-07-18 18:14:55,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:55,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:55,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. after waiting 0 ms 2023-07-18 18:14:55,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:55,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:55,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:55,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365. 2023-07-18 18:14:55,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9cfa2e31116e572b88f7a5316d0b365: 2023-07-18 18:14:55,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49. 2023-07-18 18:14:55,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for abe9745646de8ef0884e7a2af1135a49: 2023-07-18 18:14:55,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 98442a6390f9223fa54a692a0d768917, disabling compactions & flushes 2023-07-18 18:14:55,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:55,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:55,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. after waiting 0 ms 2023-07-18 18:14:55,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:55,570 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=150 updating hbase:meta row=f9cfa2e31116e572b88f7a5316d0b365, regionState=CLOSED 2023-07-18 18:14:55,570 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,r\\x1C\\xC7r\\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095570"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704095570"}]},"ts":"1689704095570"} 2023-07-18 18:14:55,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b6b580baa8178fda576f8c8c29b5ed5d, disabling compactions & flushes 2023-07-18 18:14:55,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:55,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:55,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. after waiting 0 ms 2023-07-18 18:14:55,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:55,572 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=149 updating hbase:meta row=abe9745646de8ef0884e7a2af1135a49, regionState=CLOSED 2023-07-18 18:14:55,572 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,i\\xBF\\x14i\\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095572"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704095572"}]},"ts":"1689704095572"} 2023-07-18 18:14:55,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:55,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=152, resume processing ppid=150 2023-07-18 18:14:55,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=152, ppid=150, state=SUCCESS; CloseRegionProcedure f9cfa2e31116e572b88f7a5316d0b365, server=jenkins-hbase4.apache.org,46365,1689704073486 in 165 msec 2023-07-18 18:14:55,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=155, resume processing ppid=149 2023-07-18 18:14:55,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=155, ppid=149, state=SUCCESS; CloseRegionProcedure abe9745646de8ef0884e7a2af1135a49, server=jenkins-hbase4.apache.org,46845,1689704069644 in 162 msec 2023-07-18 18:14:55,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917. 2023-07-18 18:14:55,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 98442a6390f9223fa54a692a0d768917: 2023-07-18 18:14:55,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=150, ppid=146, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=f9cfa2e31116e572b88f7a5316d0b365, UNASSIGN in 172 msec 2023-07-18 18:14:55,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:55,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=149, ppid=146, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=abe9745646de8ef0884e7a2af1135a49, UNASSIGN in 172 msec 2023-07-18 18:14:55,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d. 2023-07-18 18:14:55,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b6b580baa8178fda576f8c8c29b5ed5d: 2023-07-18 18:14:55,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,577 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=148 updating hbase:meta row=98442a6390f9223fa54a692a0d768917, regionState=CLOSED 2023-07-18 18:14:55,578 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689704095577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704095577"}]},"ts":"1689704095577"} 2023-07-18 18:14:55,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e80e9bee6a883428fd8b5c249beaa5e, disabling compactions & flushes 2023-07-18 18:14:55,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:55,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:55,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. after waiting 0 ms 2023-07-18 18:14:55,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:55,579 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=147 updating hbase:meta row=b6b580baa8178fda576f8c8c29b5ed5d, regionState=CLOSED 2023-07-18 18:14:55,580 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704095579"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704095579"}]},"ts":"1689704095579"} 2023-07-18 18:14:55,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=153, resume processing ppid=148 2023-07-18 18:14:55,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=153, ppid=148, state=SUCCESS; CloseRegionProcedure 98442a6390f9223fa54a692a0d768917, server=jenkins-hbase4.apache.org,46365,1689704073486 in 172 msec 2023-07-18 18:14:55,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=148, ppid=146, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=98442a6390f9223fa54a692a0d768917, UNASSIGN in 179 msec 2023-07-18 18:14:55,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=156, resume processing ppid=147 2023-07-18 18:14:55,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=156, ppid=147, state=SUCCESS; CloseRegionProcedure b6b580baa8178fda576f8c8c29b5ed5d, server=jenkins-hbase4.apache.org,46845,1689704069644 in 172 msec 2023-07-18 18:14:55,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=147, ppid=146, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=b6b580baa8178fda576f8c8c29b5ed5d, UNASSIGN in 181 msec 2023-07-18 18:14:55,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:14:55,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e. 2023-07-18 18:14:55,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e80e9bee6a883428fd8b5c249beaa5e: 2023-07-18 18:14:55,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,589 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=151 updating hbase:meta row=1e80e9bee6a883428fd8b5c249beaa5e, regionState=CLOSED 2023-07-18 18:14:55,589 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689704095589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704095589"}]},"ts":"1689704095589"} 2023-07-18 18:14:55,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=154, resume processing ppid=151 2023-07-18 18:14:55,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=154, ppid=151, state=SUCCESS; CloseRegionProcedure 1e80e9bee6a883428fd8b5c249beaa5e, server=jenkins-hbase4.apache.org,46845,1689704069644 in 181 msec 2023-07-18 18:14:55,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=151, resume processing ppid=146 2023-07-18 18:14:55,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=151, ppid=146, state=SUCCESS; TransitRegionStateProcedure table=Group_testDisabledTableMove, region=1e80e9bee6a883428fd8b5c249beaa5e, UNASSIGN in 188 msec 2023-07-18 18:14:55,593 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"Group_testDisabledTableMove","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704095593"}]},"ts":"1689704095593"} 2023-07-18 18:14:55,594 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=Group_testDisabledTableMove, state=DISABLED in hbase:meta 2023-07-18 18:14:55,595 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set Group_testDisabledTableMove to state=DISABLED 2023-07-18 18:14:55,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=146, state=SUCCESS; DisableTableProcedure table=Group_testDisabledTableMove in 209 msec 2023-07-18 18:14:55,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=146 2023-07-18 18:14:55,695 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:Group_testDisabledTableMove, procId: 146 completed 2023-07-18 18:14:55,695 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsAdmin1(370): Moving table Group_testDisabledTableMove to Group_testDisabledTableMove_1264411243 2023-07-18 18:14:55,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [Group_testDisabledTableMove] to rsgroup Group_testDisabledTableMove_1264411243 2023-07-18 18:14:55,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:55,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testDisabledTableMove_1264411243 2023-07-18 18:14:55,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:55,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:55,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(336): Skipping move regions because the table Group_testDisabledTableMove is disabled 2023-07-18 18:14:55,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group Group_testDisabledTableMove_1264411243, current retry=0 2023-07-18 18:14:55,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(369): All regions from table(s) [Group_testDisabledTableMove] moved to target group Group_testDisabledTableMove_1264411243. 2023-07-18 18:14:55,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:55,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:55,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:55,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=Group_testDisabledTableMove 2023-07-18 18:14:55,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:14:55,714 INFO [Listener at localhost/35951] client.HBaseAdmin$15(890): Started disable of Group_testDisabledTableMove 2023-07-18 18:14:55,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable Group_testDisabledTableMove 2023-07-18 18:14:55,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotEnabledException: Group_testDisabledTableMove at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:163) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:787) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:55,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 920 service: MasterService methodName: DisableTable size: 87 connection: 172.31.14.131:58898 deadline: 1689704155714, exception=org.apache.hadoop.hbase.TableNotEnabledException: Group_testDisabledTableMove 2023-07-18 18:14:55,715 DEBUG [Listener at localhost/35951] hbase.HBaseTestingUtility(1826): Table: Group_testDisabledTableMove already disabled, so just deleting it. 2023-07-18 18:14:55,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete Group_testDisabledTableMove 2023-07-18 18:14:55,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] procedure2.ProcedureExecutor(1029): Stored pid=158, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=Group_testDisabledTableMove 2023-07-18 18:14:55,719 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=158, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=Group_testDisabledTableMove 2023-07-18 18:14:55,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint(577): Removing deleted table 'Group_testDisabledTableMove' from rsgroup 'Group_testDisabledTableMove_1264411243' 2023-07-18 18:14:55,719 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=158, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=Group_testDisabledTableMove 2023-07-18 18:14:55,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:55,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testDisabledTableMove_1264411243 2023-07-18 18:14:55,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:55,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:55,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=158 2023-07-18 18:14:55,726 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,726 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,726 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,726 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,726 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,728 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917/recovered.edits] 2023-07-18 18:14:55,728 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d/recovered.edits] 2023-07-18 18:14:55,728 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365/recovered.edits] 2023-07-18 18:14:55,728 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49/recovered.edits] 2023-07-18 18:14:55,729 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e/f, FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e/recovered.edits] 2023-07-18 18:14:55,735 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365/recovered.edits/4.seqid 2023-07-18 18:14:55,736 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49/recovered.edits/4.seqid 2023-07-18 18:14:55,736 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917/recovered.edits/4.seqid 2023-07-18 18:14:55,736 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/f9cfa2e31116e572b88f7a5316d0b365 2023-07-18 18:14:55,737 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e/recovered.edits/4.seqid 2023-07-18 18:14:55,737 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/abe9745646de8ef0884e7a2af1135a49 2023-07-18 18:14:55,737 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d/recovered.edits/4.seqid to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/archive/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d/recovered.edits/4.seqid 2023-07-18 18:14:55,737 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/98442a6390f9223fa54a692a0d768917 2023-07-18 18:14:55,737 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/1e80e9bee6a883428fd8b5c249beaa5e 2023-07-18 18:14:55,738 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/.tmp/data/default/Group_testDisabledTableMove/b6b580baa8178fda576f8c8c29b5ed5d 2023-07-18 18:14:55,738 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived Group_testDisabledTableMove regions 2023-07-18 18:14:55,740 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=158, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=Group_testDisabledTableMove 2023-07-18 18:14:55,742 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 5 rows of Group_testDisabledTableMove from hbase:meta 2023-07-18 18:14:55,747 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'Group_testDisabledTableMove' descriptor. 2023-07-18 18:14:55,748 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=158, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=Group_testDisabledTableMove 2023-07-18 18:14:55,748 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'Group_testDisabledTableMove' from region states. 2023-07-18 18:14:55,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704095748"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:55,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704095748"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:55,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testDisabledTableMove,i\\xBF\\x14i\\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704095748"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:55,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testDisabledTableMove,r\\x1C\\xC7r\\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704095748"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:55,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704095748"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:55,750 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 5 regions from META 2023-07-18 18:14:55,750 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b6b580baa8178fda576f8c8c29b5ed5d, NAME => 'Group_testDisabledTableMove,,1689704094765.b6b580baa8178fda576f8c8c29b5ed5d.', STARTKEY => '', ENDKEY => 'aaaaa'}, {ENCODED => 98442a6390f9223fa54a692a0d768917, NAME => 'Group_testDisabledTableMove,aaaaa,1689704094765.98442a6390f9223fa54a692a0d768917.', STARTKEY => 'aaaaa', ENDKEY => 'i\xBF\x14i\xBE'}, {ENCODED => abe9745646de8ef0884e7a2af1135a49, NAME => 'Group_testDisabledTableMove,i\xBF\x14i\xBE,1689704094765.abe9745646de8ef0884e7a2af1135a49.', STARTKEY => 'i\xBF\x14i\xBE', ENDKEY => 'r\x1C\xC7r\x1B'}, {ENCODED => f9cfa2e31116e572b88f7a5316d0b365, NAME => 'Group_testDisabledTableMove,r\x1C\xC7r\x1B,1689704094765.f9cfa2e31116e572b88f7a5316d0b365.', STARTKEY => 'r\x1C\xC7r\x1B', ENDKEY => 'zzzzz'}, {ENCODED => 1e80e9bee6a883428fd8b5c249beaa5e, NAME => 'Group_testDisabledTableMove,zzzzz,1689704094765.1e80e9bee6a883428fd8b5c249beaa5e.', STARTKEY => 'zzzzz', ENDKEY => ''}] 2023-07-18 18:14:55,750 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'Group_testDisabledTableMove' as deleted. 2023-07-18 18:14:55,750 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"Group_testDisabledTableMove","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689704095750"}]},"ts":"9223372036854775807"} 2023-07-18 18:14:55,751 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table Group_testDisabledTableMove state from META 2023-07-18 18:14:55,753 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=158, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=Group_testDisabledTableMove 2023-07-18 18:14:55,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=158, state=SUCCESS; DeleteTableProcedure table=Group_testDisabledTableMove in 37 msec 2023-07-18 18:14:55,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(1230): Checking to see if procedure is done pid=158 2023-07-18 18:14:55,825 INFO [Listener at localhost/35951] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:Group_testDisabledTableMove, procId: 158 completed 2023-07-18 18:14:55,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:55,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:55,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:55,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:55,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:55,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:36811] to rsgroup default 2023-07-18 18:14:55,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:55,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_testDisabledTableMove_1264411243 2023-07-18 18:14:55,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:55,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:14:55,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(286): Moving 0 region(s) to group Group_testDisabledTableMove_1264411243, current retry=0 2023-07-18 18:14:55,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(261): All regions from [jenkins-hbase4.apache.org,36811,1689704069850, jenkins-hbase4.apache.org,43237,1689704069417] are moved back to Group_testDisabledTableMove_1264411243 2023-07-18 18:14:55,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(438): Move servers done: Group_testDisabledTableMove_1264411243 => default 2023-07-18 18:14:55,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:55,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup Group_testDisabledTableMove_1264411243 2023-07-18 18:14:55,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:55,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:55,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 5 2023-07-18 18:14:55,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:55,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:55,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:55,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:55,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:55,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:55,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:55,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:55,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:55,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:55,851 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:55,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:55,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:55,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:55,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:55,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:55,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:55,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:55,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:55,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:55,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 954 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705295861, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:55,862 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:55,863 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:55,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:55,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:55,864 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, unmovedTable, hbase:rsgroup, testRename], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:55,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:55,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:55,884 INFO [Listener at localhost/35951] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testDisabledTableMove Thread=523 (was 521) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_340288162_17 at /127.0.0.1:49630 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1288938615_17 at /127.0.0.1:44652 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x497c82a-shared-pool-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x120ad869-shared-pool-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=830 (was 821) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=432 (was 432), ProcessCount=173 (was 173), AvailableMemoryMB=2962 (was 2980) 2023-07-18 18:14:55,885 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=523 is superior to 500 2023-07-18 18:14:55,905 INFO [Listener at localhost/35951] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testRSGroupListDoesNotContainFailedTableCreation Thread=523, OpenFileDescriptor=830, MaxFileDescriptor=60000, SystemLoadAverage=432, ProcessCount=173, AvailableMemoryMB=2962 2023-07-18 18:14:55,905 WARN [Listener at localhost/35951] hbase.ResourceChecker(130): Thread=523 is superior to 500 2023-07-18 18:14:55,905 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(132): testRSGroupListDoesNotContainFailedTableCreation 2023-07-18 18:14:55,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:55,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:55,910 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'unmovedTable' 2023-07-18 18:14:55,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:14:55,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:14:55,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:14:55,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:14:55,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:14:55,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:14:55,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:55,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:14:55,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:14:55,923 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:14:55,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:14:55,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:14:55,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:14:55,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:14:55,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:14:55,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:55,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:55,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:43777] to rsgroup master 2023-07-18 18:14:55,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:14:55,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] ipc.CallRunner(144): callId: 982 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:58898 deadline: 1689705295936, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. 2023-07-18 18:14:55,937 WARN [Listener at localhost/35951] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:43777 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:14:55,938 INFO [Listener at localhost/35951] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:14:55,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:14:55,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:14:55,940 INFO [Listener at localhost/35951] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:36811, jenkins-hbase4.apache.org:43237, jenkins-hbase4.apache.org:46365, jenkins-hbase4.apache.org:46845], Tables:[hbase:meta, hbase:namespace, unmovedTable, hbase:rsgroup, testRename], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:14:55,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:14:55,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43777] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:14:55,941 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 18:14:55,942 INFO [Listener at localhost/35951] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 18:14:55,942 DEBUG [Listener at localhost/35951] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e4d79c0 to 127.0.0.1:53006 2023-07-18 18:14:55,942 DEBUG [Listener at localhost/35951] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:55,944 DEBUG [Listener at localhost/35951] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 18:14:55,944 DEBUG [Listener at localhost/35951] util.JVMClusterUtil(257): Found active master hash=707253195, stopped=false 2023-07-18 18:14:55,944 DEBUG [Listener at localhost/35951] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint 2023-07-18 18:14:55,944 DEBUG [Listener at localhost/35951] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver 2023-07-18 18:14:55,944 INFO [Listener at localhost/35951] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:55,947 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:55,947 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:55,947 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:55,947 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:55,947 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:55,947 INFO [Listener at localhost/35951] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 18:14:55,948 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:55,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:55,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:55,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:55,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:55,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:55,949 DEBUG [Listener at localhost/35951] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f728771 to 127.0.0.1:53006 2023-07-18 18:14:55,949 DEBUG [Listener at localhost/35951] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:55,950 INFO [Listener at localhost/35951] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43237,1689704069417' ***** 2023-07-18 18:14:55,951 INFO [Listener at localhost/35951] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:14:55,951 INFO [Listener at localhost/35951] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46845,1689704069644' ***** 2023-07-18 18:14:55,951 INFO [Listener at localhost/35951] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:14:55,951 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:14:55,952 INFO [Listener at localhost/35951] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36811,1689704069850' ***** 2023-07-18 18:14:55,952 INFO [Listener at localhost/35951] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:14:55,952 INFO [Listener at localhost/35951] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46365,1689704073486' ***** 2023-07-18 18:14:55,952 INFO [Listener at localhost/35951] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:14:55,952 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:14:55,952 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:14:55,952 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:14:55,972 INFO [RS:1;jenkins-hbase4:46845] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@4d520d27{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:55,973 INFO [RS:3;jenkins-hbase4:46365] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@519b7a7c{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:55,972 INFO [RS:0;jenkins-hbase4:43237] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@2a1b55bd{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:55,975 INFO [RS:2;jenkins-hbase4:36811] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@36c7be16{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:55,978 INFO [RS:1;jenkins-hbase4:46845] server.AbstractConnector(383): Stopped ServerConnector@72b0dcfa{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:14:55,978 INFO [RS:0;jenkins-hbase4:43237] server.AbstractConnector(383): Stopped ServerConnector@4cab7999{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:14:55,978 INFO [RS:1;jenkins-hbase4:46845] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:14:55,978 INFO [RS:3;jenkins-hbase4:46365] server.AbstractConnector(383): Stopped ServerConnector@1c038137{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:14:55,978 INFO [RS:2;jenkins-hbase4:36811] server.AbstractConnector(383): Stopped ServerConnector@58b8c90a{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:14:55,979 INFO [RS:3;jenkins-hbase4:46365] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:14:55,979 INFO [RS:2;jenkins-hbase4:36811] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:14:55,979 INFO [RS:1;jenkins-hbase4:46845] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@5ec386b4{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:14:55,978 INFO [RS:0;jenkins-hbase4:43237] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:14:55,981 INFO [RS:1;jenkins-hbase4:46845] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2afce463{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,STOPPED} 2023-07-18 18:14:55,981 INFO [RS:3;jenkins-hbase4:46365] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@726126ec{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:14:55,981 INFO [RS:0;jenkins-hbase4:43237] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@6a6a072{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:14:55,981 INFO [RS:2;jenkins-hbase4:36811] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@5526bfb1{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:14:55,983 INFO [RS:3;jenkins-hbase4:46365] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@6dd20c46{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,STOPPED} 2023-07-18 18:14:55,983 INFO [RS:0;jenkins-hbase4:43237] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@249e2011{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,STOPPED} 2023-07-18 18:14:55,983 INFO [RS:2;jenkins-hbase4:36811] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@477c886b{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,STOPPED} 2023-07-18 18:14:55,985 INFO [RS:1;jenkins-hbase4:46845] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:14:55,985 INFO [RS:1;jenkins-hbase4:46845] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:14:55,985 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:14:55,985 INFO [RS:1;jenkins-hbase4:46845] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:14:55,986 INFO [RS:0;jenkins-hbase4:43237] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:14:55,986 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:14:55,986 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(3305): Received CLOSE for d6adb109ae18a073027d49e3dc8869d7 2023-07-18 18:14:55,986 INFO [RS:0;jenkins-hbase4:43237] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:14:55,986 INFO [RS:0;jenkins-hbase4:43237] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:14:55,986 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:55,986 DEBUG [RS:0;jenkins-hbase4:43237] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bb27f55 to 127.0.0.1:53006 2023-07-18 18:14:55,987 INFO [RS:2;jenkins-hbase4:36811] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:14:55,987 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(3305): Received CLOSE for e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:55,987 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:14:55,987 INFO [RS:2;jenkins-hbase4:36811] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:14:55,987 DEBUG [RS:0;jenkins-hbase4:43237] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:55,987 INFO [RS:2;jenkins-hbase4:36811] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:14:55,987 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43237,1689704069417; all regions closed. 2023-07-18 18:14:55,987 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:55,987 DEBUG [RS:2;jenkins-hbase4:36811] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15b01a3a to 127.0.0.1:53006 2023-07-18 18:14:55,988 DEBUG [RS:2;jenkins-hbase4:36811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:55,988 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36811,1689704069850; all regions closed. 2023-07-18 18:14:55,988 INFO [RS:3;jenkins-hbase4:46365] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:14:55,988 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:14:55,989 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(3305): Received CLOSE for 99483aa0b47f744a4342bbff898effe0 2023-07-18 18:14:55,989 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:55,989 DEBUG [RS:1;jenkins-hbase4:46845] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a10e6bf to 127.0.0.1:53006 2023-07-18 18:14:55,989 DEBUG [RS:1;jenkins-hbase4:46845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:55,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d6adb109ae18a073027d49e3dc8869d7, disabling compactions & flushes 2023-07-18 18:14:55,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:55,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:55,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. after waiting 0 ms 2023-07-18 18:14:55,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:55,990 INFO [RS:3;jenkins-hbase4:46365] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:14:55,990 INFO [RS:3;jenkins-hbase4:46365] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:14:55,990 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(3305): Received CLOSE for 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:55,990 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:55,990 DEBUG [RS:3;jenkins-hbase4:46365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fc58c1f to 127.0.0.1:53006 2023-07-18 18:14:55,990 DEBUG [RS:3;jenkins-hbase4:46365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:55,990 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 18:14:55,990 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1478): Online Regions={3d5e3e0b3f18fd5a1a661dced24485a1=testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1.} 2023-07-18 18:14:55,991 DEBUG [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1504): Waiting on 3d5e3e0b3f18fd5a1a661dced24485a1 2023-07-18 18:14:55,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3d5e3e0b3f18fd5a1a661dced24485a1, disabling compactions & flushes 2023-07-18 18:14:55,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:55,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:55,992 INFO [RS:1;jenkins-hbase4:46845] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:14:55,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. after waiting 0 ms 2023-07-18 18:14:55,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:55,992 INFO [RS:1;jenkins-hbase4:46845] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:14:55,992 INFO [RS:1;jenkins-hbase4:46845] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:14:55,992 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 18:14:55,999 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:14:56,000 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1474): Waiting on 4 regions to close 2023-07-18 18:14:56,000 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1478): Online Regions={d6adb109ae18a073027d49e3dc8869d7=hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7., 1588230740=hbase:meta,,1.1588230740, e5f0535b173f09210c6c23ff8aa93af6=unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6., 99483aa0b47f744a4342bbff898effe0=hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0.} 2023-07-18 18:14:56,000 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1504): Waiting on 1588230740, 99483aa0b47f744a4342bbff898effe0, d6adb109ae18a073027d49e3dc8869d7, e5f0535b173f09210c6c23ff8aa93af6 2023-07-18 18:14:56,000 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:14:56,000 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:14:56,000 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:14:56,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:14:56,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:14:56,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:14:56,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:14:56,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:14:56,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=36.31 KB heapSize=59.22 KB 2023-07-18 18:14:56,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/namespace/d6adb109ae18a073027d49e3dc8869d7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=9 2023-07-18 18:14:56,018 DEBUG [RS:0;jenkins-hbase4:43237] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs 2023-07-18 18:14:56,018 INFO [RS:0;jenkins-hbase4:43237] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43237%2C1689704069417:(num 1689704071953) 2023-07-18 18:14:56,018 DEBUG [RS:0;jenkins-hbase4:43237] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:56,018 INFO [RS:0;jenkins-hbase4:43237] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:14:56,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:56,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d6adb109ae18a073027d49e3dc8869d7: 2023-07-18 18:14:56,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689704072377.d6adb109ae18a073027d49e3dc8869d7. 2023-07-18 18:14:56,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/testRename/3d5e3e0b3f18fd5a1a661dced24485a1/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=7 2023-07-18 18:14:56,021 DEBUG [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs 2023-07-18 18:14:56,021 INFO [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36811%2C1689704069850.meta:.meta(num 1689704072151) 2023-07-18 18:14:56,021 INFO [RS:0;jenkins-hbase4:43237] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:14:56,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e5f0535b173f09210c6c23ff8aa93af6, disabling compactions & flushes 2023-07-18 18:14:56,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:56,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:56,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. after waiting 0 ms 2023-07-18 18:14:56,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:56,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:56,023 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:14:56,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3d5e3e0b3f18fd5a1a661dced24485a1: 2023-07-18 18:14:56,023 INFO [RS:0;jenkins-hbase4:43237] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:14:56,023 INFO [RS:0;jenkins-hbase4:43237] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:14:56,023 INFO [RS:0;jenkins-hbase4:43237] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:14:56,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testRename,,1689704089127.3d5e3e0b3f18fd5a1a661dced24485a1. 2023-07-18 18:14:56,027 INFO [RS:0;jenkins-hbase4:43237] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43237 2023-07-18 18:14:56,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/default/unmovedTable/e5f0535b173f09210c6c23ff8aa93af6/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=7 2023-07-18 18:14:56,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:56,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e5f0535b173f09210c6c23ff8aa93af6: 2023-07-18 18:14:56,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed unmovedTable,,1689704090788.e5f0535b173f09210c6c23ff8aa93af6. 2023-07-18 18:14:56,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 99483aa0b47f744a4342bbff898effe0, disabling compactions & flushes 2023-07-18 18:14:56,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:56,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:56,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. after waiting 0 ms 2023-07-18 18:14:56,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:56,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 99483aa0b47f744a4342bbff898effe0 1/1 column families, dataSize=27.11 KB heapSize=44.64 KB 2023-07-18 18:14:56,039 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:56,040 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:56,040 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:56,040 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:56,040 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:56,040 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:56,040 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43237,1689704069417 2023-07-18 18:14:56,039 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:56,040 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:56,042 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43237,1689704069417] 2023-07-18 18:14:56,042 DEBUG [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs 2023-07-18 18:14:56,042 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43237,1689704069417; numProcessing=1 2023-07-18 18:14:56,042 INFO [RS:2;jenkins-hbase4:36811] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36811%2C1689704069850:(num 1689704071953) 2023-07-18 18:14:56,042 DEBUG [RS:2;jenkins-hbase4:36811] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:56,042 INFO [RS:2;jenkins-hbase4:36811] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:14:56,043 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43237,1689704069417 already deleted, retry=false 2023-07-18 18:14:56,044 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43237,1689704069417 expired; onlineServers=3 2023-07-18 18:14:56,053 INFO [RS:2;jenkins-hbase4:36811] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:14:56,054 INFO [RS:2;jenkins-hbase4:36811] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:14:56,054 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:14:56,054 INFO [RS:2;jenkins-hbase4:36811] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:14:56,054 INFO [RS:2;jenkins-hbase4:36811] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:14:56,056 INFO [RS:2;jenkins-hbase4:36811] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36811 2023-07-18 18:14:56,057 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:56,057 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:56,058 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:56,058 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36811,1689704069850 2023-07-18 18:14:56,058 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36811,1689704069850] 2023-07-18 18:14:56,059 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36811,1689704069850; numProcessing=2 2023-07-18 18:14:56,062 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36811,1689704069850 already deleted, retry=false 2023-07-18 18:14:56,062 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36811,1689704069850 expired; onlineServers=2 2023-07-18 18:14:56,071 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=33.39 KB at sequenceid=216 (bloomFilter=false), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/info/c86e51af875849a09feb150f45bff0fb 2023-07-18 18:14:56,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c86e51af875849a09feb150f45bff0fb 2023-07-18 18:14:56,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=27.11 KB at sequenceid=101 (bloomFilter=true), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/.tmp/m/216820a49a4741c5b49f7192626dc4a2 2023-07-18 18:14:56,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 216820a49a4741c5b49f7192626dc4a2 2023-07-18 18:14:56,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/.tmp/m/216820a49a4741c5b49f7192626dc4a2 as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m/216820a49a4741c5b49f7192626dc4a2 2023-07-18 18:14:56,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 216820a49a4741c5b49f7192626dc4a2 2023-07-18 18:14:56,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/m/216820a49a4741c5b49f7192626dc4a2, entries=28, sequenceid=101, filesize=6.1 K 2023-07-18 18:14:56,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~27.11 KB/27762, heapSize ~44.63 KB/45696, currentSize=0 B/0 for 99483aa0b47f744a4342bbff898effe0 in 74ms, sequenceid=101, compaction requested=false 2023-07-18 18:14:56,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=868 B at sequenceid=216 (bloomFilter=false), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/rep_barrier/b994fb568c2a4dd4b3c9f572b32e4d55 2023-07-18 18:14:56,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/rsgroup/99483aa0b47f744a4342bbff898effe0/recovered.edits/104.seqid, newMaxSeqId=104, maxSeqId=12 2023-07-18 18:14:56,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:14:56,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:56,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 99483aa0b47f744a4342bbff898effe0: 2023-07-18 18:14:56,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:rsgroup,,1689704072631.99483aa0b47f744a4342bbff898effe0. 2023-07-18 18:14:56,131 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b994fb568c2a4dd4b3c9f572b32e4d55 2023-07-18 18:14:56,147 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:56,147 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:43237-0x10179a470da0001, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:56,150 INFO [RS:0;jenkins-hbase4:43237] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43237,1689704069417; zookeeper connection closed. 2023-07-18 18:14:56,152 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@8b084a7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@8b084a7 2023-07-18 18:14:56,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.07 KB at sequenceid=216 (bloomFilter=false), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/table/3f1acf51d9c04553947944fe26a6f526 2023-07-18 18:14:56,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f1acf51d9c04553947944fe26a6f526 2023-07-18 18:14:56,182 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/info/c86e51af875849a09feb150f45bff0fb as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/c86e51af875849a09feb150f45bff0fb 2023-07-18 18:14:56,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c86e51af875849a09feb150f45bff0fb 2023-07-18 18:14:56,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/info/c86e51af875849a09feb150f45bff0fb, entries=52, sequenceid=216, filesize=10.7 K 2023-07-18 18:14:56,191 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46365,1689704073486; all regions closed. 2023-07-18 18:14:56,192 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/rep_barrier/b994fb568c2a4dd4b3c9f572b32e4d55 as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier/b994fb568c2a4dd4b3c9f572b32e4d55 2023-07-18 18:14:56,201 DEBUG [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 18:14:56,202 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b994fb568c2a4dd4b3c9f572b32e4d55 2023-07-18 18:14:56,203 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/rep_barrier/b994fb568c2a4dd4b3c9f572b32e4d55, entries=8, sequenceid=216, filesize=5.8 K 2023-07-18 18:14:56,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/.tmp/table/3f1acf51d9c04553947944fe26a6f526 as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/3f1acf51d9c04553947944fe26a6f526 2023-07-18 18:14:56,205 DEBUG [RS:3;jenkins-hbase4:46365] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs 2023-07-18 18:14:56,205 INFO [RS:3;jenkins-hbase4:46365] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46365%2C1689704073486.meta:.meta(num 1689704074854) 2023-07-18 18:14:56,214 DEBUG [RS:3;jenkins-hbase4:46365] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs 2023-07-18 18:14:56,215 INFO [RS:3;jenkins-hbase4:46365] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46365%2C1689704073486:(num 1689704073930) 2023-07-18 18:14:56,215 DEBUG [RS:3;jenkins-hbase4:46365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:56,215 INFO [RS:3;jenkins-hbase4:46365] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:14:56,215 INFO [RS:3;jenkins-hbase4:46365] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 18:14:56,215 INFO [RS:3;jenkins-hbase4:46365] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:14:56,215 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:14:56,215 INFO [RS:3;jenkins-hbase4:46365] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:14:56,215 INFO [RS:3;jenkins-hbase4:46365] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:14:56,216 INFO [RS:3;jenkins-hbase4:46365] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46365 2023-07-18 18:14:56,218 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:56,218 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:56,218 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46365,1689704073486 2023-07-18 18:14:56,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f1acf51d9c04553947944fe26a6f526 2023-07-18 18:14:56,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/table/3f1acf51d9c04553947944fe26a6f526, entries=16, sequenceid=216, filesize=6.0 K 2023-07-18 18:14:56,227 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46365,1689704073486] 2023-07-18 18:14:56,227 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46365,1689704073486; numProcessing=3 2023-07-18 18:14:56,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~36.31 KB/37186, heapSize ~59.17 KB/60592, currentSize=0 B/0 for 1588230740 in 220ms, sequenceid=216, compaction requested=true 2023-07-18 18:14:56,227 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 18:14:56,228 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46365,1689704073486 already deleted, retry=false 2023-07-18 18:14:56,228 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46365,1689704073486 expired; onlineServers=1 2023-07-18 18:14:56,257 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/data/hbase/meta/1588230740/recovered.edits/219.seqid, newMaxSeqId=219, maxSeqId=107 2023-07-18 18:14:56,258 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:14:56,258 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:14:56,259 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:14:56,259 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 18:14:56,402 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46845,1689704069644; all regions closed. 2023-07-18 18:14:56,408 DEBUG [RS:1;jenkins-hbase4:46845] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs 2023-07-18 18:14:56,408 INFO [RS:1;jenkins-hbase4:46845] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46845%2C1689704069644.meta:.meta(num 1689704081621) 2023-07-18 18:14:56,414 DEBUG [RS:1;jenkins-hbase4:46845] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/oldWALs 2023-07-18 18:14:56,414 INFO [RS:1;jenkins-hbase4:46845] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46845%2C1689704069644:(num 1689704071953) 2023-07-18 18:14:56,415 DEBUG [RS:1;jenkins-hbase4:46845] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:56,415 INFO [RS:1;jenkins-hbase4:46845] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:14:56,415 INFO [RS:1;jenkins-hbase4:46845] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 18:14:56,415 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:14:56,416 INFO [RS:1;jenkins-hbase4:46845] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46845 2023-07-18 18:14:56,418 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46845,1689704069644 2023-07-18 18:14:56,418 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:56,419 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46845,1689704069644] 2023-07-18 18:14:56,419 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46845,1689704069644; numProcessing=4 2023-07-18 18:14:56,420 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46845,1689704069644 already deleted, retry=false 2023-07-18 18:14:56,420 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46845,1689704069644 expired; onlineServers=0 2023-07-18 18:14:56,420 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43777,1689704067457' ***** 2023-07-18 18:14:56,420 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 18:14:56,421 DEBUG [M:0;jenkins-hbase4:43777] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b1ad9f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:14:56,421 INFO [M:0;jenkins-hbase4:43777] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:14:56,423 INFO [M:0;jenkins-hbase4:43777] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@9ca6b1f{master,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-18 18:14:56,423 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:56,424 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:56,424 INFO [M:0;jenkins-hbase4:43777] server.AbstractConnector(383): Stopped ServerConnector@668fa014{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:14:56,424 INFO [M:0;jenkins-hbase4:43777] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:14:56,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:56,424 INFO [M:0;jenkins-hbase4:43777] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@5310d071{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:14:56,425 INFO [M:0;jenkins-hbase4:43777] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@966e0ef{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir/,STOPPED} 2023-07-18 18:14:56,425 INFO [M:0;jenkins-hbase4:43777] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43777,1689704067457 2023-07-18 18:14:56,425 INFO [M:0;jenkins-hbase4:43777] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43777,1689704067457; all regions closed. 2023-07-18 18:14:56,425 DEBUG [M:0;jenkins-hbase4:43777] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:14:56,425 INFO [M:0;jenkins-hbase4:43777] master.HMaster(1491): Stopping master jetty server 2023-07-18 18:14:56,426 INFO [M:0;jenkins-hbase4:43777] server.AbstractConnector(383): Stopped ServerConnector@256662d9{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:14:56,426 DEBUG [M:0;jenkins-hbase4:43777] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 18:14:56,426 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 18:14:56,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704071516] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704071516,5,FailOnTimeoutGroup] 2023-07-18 18:14:56,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704071517] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704071517,5,FailOnTimeoutGroup] 2023-07-18 18:14:56,427 DEBUG [M:0;jenkins-hbase4:43777] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 18:14:56,427 INFO [M:0;jenkins-hbase4:43777] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 18:14:56,427 INFO [M:0;jenkins-hbase4:43777] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 18:14:56,427 INFO [M:0;jenkins-hbase4:43777] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 18:14:56,427 DEBUG [M:0;jenkins-hbase4:43777] master.HMaster(1512): Stopping service threads 2023-07-18 18:14:56,427 INFO [M:0;jenkins-hbase4:43777] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 18:14:56,427 ERROR [M:0;jenkins-hbase4:43777] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-18 18:14:56,428 INFO [M:0;jenkins-hbase4:43777] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 18:14:56,428 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 18:14:56,429 DEBUG [M:0;jenkins-hbase4:43777] zookeeper.ZKUtil(398): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 18:14:56,429 WARN [M:0;jenkins-hbase4:43777] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 18:14:56,429 INFO [M:0;jenkins-hbase4:43777] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 18:14:56,429 INFO [M:0;jenkins-hbase4:43777] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 18:14:56,429 DEBUG [M:0;jenkins-hbase4:43777] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:14:56,429 INFO [M:0;jenkins-hbase4:43777] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:56,429 DEBUG [M:0;jenkins-hbase4:43777] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:56,430 DEBUG [M:0;jenkins-hbase4:43777] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 1 ms 2023-07-18 18:14:56,430 DEBUG [M:0;jenkins-hbase4:43777] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:56,430 INFO [M:0;jenkins-hbase4:43777] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=528.47 KB heapSize=632.63 KB 2023-07-18 18:14:56,752 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:56,752 INFO [RS:1;jenkins-hbase4:46845] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46845,1689704069644; zookeeper connection closed. 2023-07-18 18:14:56,752 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46845-0x10179a470da0002, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:56,752 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2b666eae] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2b666eae 2023-07-18 18:14:56,852 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:56,852 INFO [M:0;jenkins-hbase4:43777] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=528.47 KB at sequenceid=1176 (bloomFilter=true), to=hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9ad9c712362a43c59209640b27bcd569 2023-07-18 18:14:56,852 INFO [RS:3;jenkins-hbase4:46365] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46365,1689704073486; zookeeper connection closed. 2023-07-18 18:14:56,852 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:46365-0x10179a470da000b, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:56,853 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2d8271fa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2d8271fa 2023-07-18 18:14:56,859 DEBUG [M:0;jenkins-hbase4:43777] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9ad9c712362a43c59209640b27bcd569 as hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9ad9c712362a43c59209640b27bcd569 2023-07-18 18:14:56,865 INFO [M:0;jenkins-hbase4:43777] regionserver.HStore(1080): Added hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9ad9c712362a43c59209640b27bcd569, entries=157, sequenceid=1176, filesize=27.6 K 2023-07-18 18:14:56,866 INFO [M:0;jenkins-hbase4:43777] regionserver.HRegion(2948): Finished flush of dataSize ~528.47 KB/541152, heapSize ~632.62 KB/647800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 436ms, sequenceid=1176, compaction requested=false 2023-07-18 18:14:56,868 INFO [M:0;jenkins-hbase4:43777] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:56,868 DEBUG [M:0;jenkins-hbase4:43777] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:14:56,873 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:14:56,873 INFO [M:0;jenkins-hbase4:43777] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 18:14:56,874 INFO [M:0;jenkins-hbase4:43777] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43777 2023-07-18 18:14:56,876 DEBUG [M:0;jenkins-hbase4:43777] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43777,1689704067457 already deleted, retry=false 2023-07-18 18:14:56,952 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:56,952 INFO [RS:2;jenkins-hbase4:36811] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36811,1689704069850; zookeeper connection closed. 2023-07-18 18:14:56,953 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): regionserver:36811-0x10179a470da0003, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:56,953 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@74b6cbb2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@74b6cbb2 2023-07-18 18:14:56,953 INFO [Listener at localhost/35951] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 4 regionserver(s) complete 2023-07-18 18:14:57,053 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:57,053 INFO [M:0;jenkins-hbase4:43777] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43777,1689704067457; zookeeper connection closed. 2023-07-18 18:14:57,053 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): master:43777-0x10179a470da0000, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:14:57,055 WARN [Listener at localhost/35951] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:14:57,059 INFO [Listener at localhost/35951] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:14:57,162 WARN [BP-803566363-172.31.14.131-1689704063768 heartbeating to localhost/127.0.0.1:46377] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:14:57,162 WARN [BP-803566363-172.31.14.131-1689704063768 heartbeating to localhost/127.0.0.1:46377] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-803566363-172.31.14.131-1689704063768 (Datanode Uuid 04e0b4bf-a58d-486e-8378-1dc8535ea936) service to localhost/127.0.0.1:46377 2023-07-18 18:14:57,164 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/dfs/data/data5/current/BP-803566363-172.31.14.131-1689704063768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:14:57,164 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/dfs/data/data6/current/BP-803566363-172.31.14.131-1689704063768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:14:57,166 WARN [Listener at localhost/35951] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:14:57,169 INFO [Listener at localhost/35951] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:14:57,272 WARN [BP-803566363-172.31.14.131-1689704063768 heartbeating to localhost/127.0.0.1:46377] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:14:57,272 WARN [BP-803566363-172.31.14.131-1689704063768 heartbeating to localhost/127.0.0.1:46377] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-803566363-172.31.14.131-1689704063768 (Datanode Uuid 89463cbd-8177-4d6f-8e0e-d11a043c7fb8) service to localhost/127.0.0.1:46377 2023-07-18 18:14:57,273 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/dfs/data/data3/current/BP-803566363-172.31.14.131-1689704063768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:14:57,273 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/dfs/data/data4/current/BP-803566363-172.31.14.131-1689704063768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:14:57,274 WARN [Listener at localhost/35951] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:14:57,276 INFO [Listener at localhost/35951] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:14:57,380 WARN [BP-803566363-172.31.14.131-1689704063768 heartbeating to localhost/127.0.0.1:46377] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:14:57,380 WARN [BP-803566363-172.31.14.131-1689704063768 heartbeating to localhost/127.0.0.1:46377] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-803566363-172.31.14.131-1689704063768 (Datanode Uuid 673eccaf-a708-44dc-9800-fa302ef433e7) service to localhost/127.0.0.1:46377 2023-07-18 18:14:57,381 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/dfs/data/data1/current/BP-803566363-172.31.14.131-1689704063768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:14:57,382 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/cluster_bb694169-d446-6bb9-92b7-63318c528d3e/dfs/data/data2/current/BP-803566363-172.31.14.131-1689704063768] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:14:57,428 INFO [Listener at localhost/35951] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:14:57,466 INFO [Listener at localhost/35951] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 18:14:57,545 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-18 18:14:57,545 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 18:14:57,545 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.log.dir so I do NOT create it in target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/ad0b5d54-c564-8969-5880-17467a87a8f1/hadoop.tmp.dir so I do NOT create it in target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887, deleteOnExit=true 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/test.cache.data in system properties and HBase conf 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir in system properties and HBase conf 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 18:14:57,546 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 18:14:57,547 DEBUG [Listener at localhost/35951] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 18:14:57,547 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:14:57,547 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:14:57,547 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 18:14:57,547 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:14:57,547 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 18:14:57,547 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 18:14:57,547 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:14:57,548 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:14:57,548 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 18:14:57,548 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/nfs.dump.dir in system properties and HBase conf 2023-07-18 18:14:57,548 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir in system properties and HBase conf 2023-07-18 18:14:57,548 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:14:57,548 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 18:14:57,548 INFO [Listener at localhost/35951] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 18:14:57,553 WARN [Listener at localhost/35951] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:14:57,554 WARN [Listener at localhost/35951] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:14:57,557 DEBUG [Listener at localhost/35951-EventThread] zookeeper.ZKWatcher(600): VerifyingRSGroupAdminClient-0x10179a470da000a, quorum=127.0.0.1:53006, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2023-07-18 18:14:57,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(630): VerifyingRSGroupAdminClient-0x10179a470da000a, quorum=127.0.0.1:53006, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2023-07-18 18:14:57,610 WARN [Listener at localhost/35951] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:14:57,613 INFO [Listener at localhost/35951] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:14:57,618 INFO [Listener at localhost/35951] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir/Jetty_localhost_40117_hdfs____ffnkxx/webapp 2023-07-18 18:14:57,634 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:14:57,634 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver 2023-07-18 18:14:57,634 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint 2023-07-18 18:14:57,713 INFO [Listener at localhost/35951] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40117 2023-07-18 18:14:57,747 WARN [Listener at localhost/35951] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:14:57,747 WARN [Listener at localhost/35951] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:14:57,793 WARN [Listener at localhost/34101] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:14:57,810 WARN [Listener at localhost/34101] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:14:57,812 WARN [Listener at localhost/34101] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:14:57,813 INFO [Listener at localhost/34101] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:14:57,818 INFO [Listener at localhost/34101] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir/Jetty_localhost_43259_datanode____n88ela/webapp 2023-07-18 18:14:57,922 INFO [Listener at localhost/34101] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43259 2023-07-18 18:14:57,930 WARN [Listener at localhost/33329] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:14:57,961 WARN [Listener at localhost/33329] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:14:57,964 WARN [Listener at localhost/33329] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:14:57,965 INFO [Listener at localhost/33329] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:14:57,968 INFO [Listener at localhost/33329] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir/Jetty_localhost_45723_datanode____.rw4yrm/webapp 2023-07-18 18:14:58,057 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd338478c2e16bb16: Processing first storage report for DS-d0f5449a-4098-4d29-b485-97037d6660b8 from datanode f6fbe9a7-c1c9-4c40-bd33-eca9f837a293 2023-07-18 18:14:58,058 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd338478c2e16bb16: from storage DS-d0f5449a-4098-4d29-b485-97037d6660b8 node DatanodeRegistration(127.0.0.1:35317, datanodeUuid=f6fbe9a7-c1c9-4c40-bd33-eca9f837a293, infoPort=43111, infoSecurePort=0, ipcPort=33329, storageInfo=lv=-57;cid=testClusterID;nsid=114182028;c=1689704097559), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-18 18:14:58,058 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd338478c2e16bb16: Processing first storage report for DS-945dcdc8-e8ec-47a2-a894-3e5e91bbd2a0 from datanode f6fbe9a7-c1c9-4c40-bd33-eca9f837a293 2023-07-18 18:14:58,058 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd338478c2e16bb16: from storage DS-945dcdc8-e8ec-47a2-a894-3e5e91bbd2a0 node DatanodeRegistration(127.0.0.1:35317, datanodeUuid=f6fbe9a7-c1c9-4c40-bd33-eca9f837a293, infoPort=43111, infoSecurePort=0, ipcPort=33329, storageInfo=lv=-57;cid=testClusterID;nsid=114182028;c=1689704097559), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:58,087 INFO [Listener at localhost/33329] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45723 2023-07-18 18:14:58,097 WARN [Listener at localhost/41243] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:14:58,125 WARN [Listener at localhost/41243] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:14:58,128 WARN [Listener at localhost/41243] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:14:58,130 INFO [Listener at localhost/41243] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:14:58,134 INFO [Listener at localhost/41243] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir/Jetty_localhost_35709_datanode____8d4ukl/webapp 2023-07-18 18:14:58,243 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9fdb7cc49809409: Processing first storage report for DS-3a993805-523a-4044-acb8-8330dc629998 from datanode 375062e7-29a0-485d-87d6-90e44a21364a 2023-07-18 18:14:58,243 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9fdb7cc49809409: from storage DS-3a993805-523a-4044-acb8-8330dc629998 node DatanodeRegistration(127.0.0.1:40679, datanodeUuid=375062e7-29a0-485d-87d6-90e44a21364a, infoPort=40191, infoSecurePort=0, ipcPort=41243, storageInfo=lv=-57;cid=testClusterID;nsid=114182028;c=1689704097559), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:58,243 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9fdb7cc49809409: Processing first storage report for DS-1dcfba11-86ad-4ffd-95a2-1abaaa46aa24 from datanode 375062e7-29a0-485d-87d6-90e44a21364a 2023-07-18 18:14:58,243 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9fdb7cc49809409: from storage DS-1dcfba11-86ad-4ffd-95a2-1abaaa46aa24 node DatanodeRegistration(127.0.0.1:40679, datanodeUuid=375062e7-29a0-485d-87d6-90e44a21364a, infoPort=40191, infoSecurePort=0, ipcPort=41243, storageInfo=lv=-57;cid=testClusterID;nsid=114182028;c=1689704097559), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:58,262 INFO [Listener at localhost/41243] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35709 2023-07-18 18:14:58,270 WARN [Listener at localhost/33663] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:14:58,380 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd3ace32a82b792a: Processing first storage report for DS-bc99861f-f050-4aaf-aa4c-16699ee5e428 from datanode 486e18f6-21f2-42dd-9bd0-45d5de8dfc72 2023-07-18 18:14:58,380 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd3ace32a82b792a: from storage DS-bc99861f-f050-4aaf-aa4c-16699ee5e428 node DatanodeRegistration(127.0.0.1:43299, datanodeUuid=486e18f6-21f2-42dd-9bd0-45d5de8dfc72, infoPort=43045, infoSecurePort=0, ipcPort=33663, storageInfo=lv=-57;cid=testClusterID;nsid=114182028;c=1689704097559), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:58,380 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd3ace32a82b792a: Processing first storage report for DS-3785b285-adb8-4007-ab4d-d44863b642f5 from datanode 486e18f6-21f2-42dd-9bd0-45d5de8dfc72 2023-07-18 18:14:58,380 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd3ace32a82b792a: from storage DS-3785b285-adb8-4007-ab4d-d44863b642f5 node DatanodeRegistration(127.0.0.1:43299, datanodeUuid=486e18f6-21f2-42dd-9bd0-45d5de8dfc72, infoPort=43045, infoSecurePort=0, ipcPort=33663, storageInfo=lv=-57;cid=testClusterID;nsid=114182028;c=1689704097559), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:14:58,479 DEBUG [Listener at localhost/33663] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5 2023-07-18 18:14:58,482 INFO [Listener at localhost/33663] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/zookeeper_0, clientPort=58836, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 18:14:58,485 INFO [Listener at localhost/33663] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58836 2023-07-18 18:14:58,485 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:58,486 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:58,503 INFO [Listener at localhost/33663] util.FSUtils(471): Created version file at hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320 with version=8 2023-07-18 18:14:58,503 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/hbase-staging 2023-07-18 18:14:58,504 DEBUG [Listener at localhost/33663] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-18 18:14:58,504 DEBUG [Listener at localhost/33663] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-18 18:14:58,504 DEBUG [Listener at localhost/33663] hbase.LocalHBaseCluster(151): Setting RS InfoServer Port to random. 2023-07-18 18:14:58,504 DEBUG [Listener at localhost/33663] hbase.LocalHBaseCluster(159): Setting Master InfoServer Port to random. 2023-07-18 18:14:58,505 INFO [Listener at localhost/33663] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:58,505 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,505 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,505 INFO [Listener at localhost/33663] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:58,506 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,506 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:58,506 INFO [Listener at localhost/33663] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:58,507 INFO [Listener at localhost/33663] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38247 2023-07-18 18:14:58,507 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:58,508 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:58,509 INFO [Listener at localhost/33663] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38247 connecting to ZooKeeper ensemble=127.0.0.1:58836 2023-07-18 18:14:58,518 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:382470x0, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:58,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38247-0x10179a4edb40000 connected 2023-07-18 18:14:58,534 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:58,535 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:58,535 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:58,536 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38247 2023-07-18 18:14:58,538 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38247 2023-07-18 18:14:58,539 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38247 2023-07-18 18:14:58,542 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38247 2023-07-18 18:14:58,543 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38247 2023-07-18 18:14:58,544 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:58,545 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:58,545 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:58,545 INFO [Listener at localhost/33663] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-18 18:14:58,545 INFO [Listener at localhost/33663] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:58,545 INFO [Listener at localhost/33663] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:58,545 INFO [Listener at localhost/33663] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:58,546 INFO [Listener at localhost/33663] http.HttpServer(1146): Jetty bound to port 43805 2023-07-18 18:14:58,546 INFO [Listener at localhost/33663] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:58,550 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:58,550 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@44a9cf4{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:58,551 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:58,551 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@625ee407{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:58,675 INFO [Listener at localhost/33663] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:58,677 INFO [Listener at localhost/33663] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:58,677 INFO [Listener at localhost/33663] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:58,677 INFO [Listener at localhost/33663] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:58,679 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:58,681 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@3362b59a{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir/jetty-0_0_0_0-43805-hbase-server-2_4_18-SNAPSHOT_jar-_-any-1538321418609185921/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-18 18:14:58,682 INFO [Listener at localhost/33663] server.AbstractConnector(333): Started ServerConnector@326eddd2{HTTP/1.1, (http/1.1)}{0.0.0.0:43805} 2023-07-18 18:14:58,682 INFO [Listener at localhost/33663] server.Server(415): Started @36958ms 2023-07-18 18:14:58,682 INFO [Listener at localhost/33663] master.HMaster(444): hbase.rootdir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320, hbase.cluster.distributed=false 2023-07-18 18:14:58,702 INFO [Listener at localhost/33663] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:58,702 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,702 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,702 INFO [Listener at localhost/33663] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:58,702 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,703 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:58,703 INFO [Listener at localhost/33663] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:58,703 INFO [Listener at localhost/33663] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34463 2023-07-18 18:14:58,704 INFO [Listener at localhost/33663] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:14:58,705 DEBUG [Listener at localhost/33663] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:14:58,706 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:58,707 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:58,708 INFO [Listener at localhost/33663] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34463 connecting to ZooKeeper ensemble=127.0.0.1:58836 2023-07-18 18:14:58,711 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:344630x0, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:58,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34463-0x10179a4edb40001 connected 2023-07-18 18:14:58,712 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:58,713 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:58,714 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:58,716 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34463 2023-07-18 18:14:58,716 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34463 2023-07-18 18:14:58,716 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34463 2023-07-18 18:14:58,717 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34463 2023-07-18 18:14:58,717 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34463 2023-07-18 18:14:58,719 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:58,719 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:58,719 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:58,720 INFO [Listener at localhost/33663] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:14:58,720 INFO [Listener at localhost/33663] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:58,720 INFO [Listener at localhost/33663] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:58,720 INFO [Listener at localhost/33663] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:58,721 INFO [Listener at localhost/33663] http.HttpServer(1146): Jetty bound to port 45709 2023-07-18 18:14:58,721 INFO [Listener at localhost/33663] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:58,723 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:58,723 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@3ee8c6a2{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:58,723 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:58,723 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@204cfa25{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:58,842 INFO [Listener at localhost/33663] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:58,843 INFO [Listener at localhost/33663] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:58,843 INFO [Listener at localhost/33663] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:58,843 INFO [Listener at localhost/33663] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:58,844 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:58,845 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@59f5ce37{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir/jetty-0_0_0_0-45709-hbase-server-2_4_18-SNAPSHOT_jar-_-any-2371940622352635249/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:58,847 INFO [Listener at localhost/33663] server.AbstractConnector(333): Started ServerConnector@23cf60b9{HTTP/1.1, (http/1.1)}{0.0.0.0:45709} 2023-07-18 18:14:58,847 INFO [Listener at localhost/33663] server.Server(415): Started @37123ms 2023-07-18 18:14:58,858 INFO [Listener at localhost/33663] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:58,859 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,859 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,859 INFO [Listener at localhost/33663] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:58,859 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:58,859 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:58,859 INFO [Listener at localhost/33663] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:58,860 INFO [Listener at localhost/33663] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36449 2023-07-18 18:14:58,860 INFO [Listener at localhost/33663] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:14:58,861 DEBUG [Listener at localhost/33663] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:14:58,862 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:58,863 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:58,864 INFO [Listener at localhost/33663] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36449 connecting to ZooKeeper ensemble=127.0.0.1:58836 2023-07-18 18:14:58,868 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:364490x0, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:58,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36449-0x10179a4edb40002 connected 2023-07-18 18:14:58,869 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:364490x0, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:58,870 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:58,870 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:58,871 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36449 2023-07-18 18:14:58,871 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36449 2023-07-18 18:14:58,872 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36449 2023-07-18 18:14:58,874 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36449 2023-07-18 18:14:58,874 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36449 2023-07-18 18:14:58,876 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:58,877 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:58,877 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:58,877 INFO [Listener at localhost/33663] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:14:58,877 INFO [Listener at localhost/33663] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:58,877 INFO [Listener at localhost/33663] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:58,877 INFO [Listener at localhost/33663] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:58,878 INFO [Listener at localhost/33663] http.HttpServer(1146): Jetty bound to port 33543 2023-07-18 18:14:58,878 INFO [Listener at localhost/33663] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:58,883 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:58,883 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@30ad32c0{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:58,883 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:58,883 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@321cd692{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:59,005 INFO [Listener at localhost/33663] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:59,007 INFO [Listener at localhost/33663] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:59,007 INFO [Listener at localhost/33663] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:59,007 INFO [Listener at localhost/33663] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:59,008 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:59,008 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@1fa6830d{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir/jetty-0_0_0_0-33543-hbase-server-2_4_18-SNAPSHOT_jar-_-any-1450898940451790567/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:59,010 INFO [Listener at localhost/33663] server.AbstractConnector(333): Started ServerConnector@1a24290f{HTTP/1.1, (http/1.1)}{0.0.0.0:33543} 2023-07-18 18:14:59,010 INFO [Listener at localhost/33663] server.Server(415): Started @37286ms 2023-07-18 18:14:59,021 INFO [Listener at localhost/33663] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:14:59,021 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:59,021 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:59,022 INFO [Listener at localhost/33663] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:14:59,022 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:14:59,022 INFO [Listener at localhost/33663] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:14:59,022 INFO [Listener at localhost/33663] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:14:59,023 INFO [Listener at localhost/33663] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42293 2023-07-18 18:14:59,024 INFO [Listener at localhost/33663] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:14:59,025 DEBUG [Listener at localhost/33663] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:14:59,026 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:59,027 INFO [Listener at localhost/33663] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:59,028 INFO [Listener at localhost/33663] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42293 connecting to ZooKeeper ensemble=127.0.0.1:58836 2023-07-18 18:14:59,034 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:422930x0, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:14:59,036 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:422930x0, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:14:59,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42293-0x10179a4edb40003 connected 2023-07-18 18:14:59,036 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:14:59,037 DEBUG [Listener at localhost/33663] zookeeper.ZKUtil(164): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:14:59,041 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42293 2023-07-18 18:14:59,041 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42293 2023-07-18 18:14:59,042 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42293 2023-07-18 18:14:59,043 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42293 2023-07-18 18:14:59,046 DEBUG [Listener at localhost/33663] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42293 2023-07-18 18:14:59,047 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:14:59,047 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:14:59,048 INFO [Listener at localhost/33663] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:14:59,048 INFO [Listener at localhost/33663] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:14:59,048 INFO [Listener at localhost/33663] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:14:59,048 INFO [Listener at localhost/33663] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:14:59,048 INFO [Listener at localhost/33663] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:14:59,049 INFO [Listener at localhost/33663] http.HttpServer(1146): Jetty bound to port 37087 2023-07-18 18:14:59,049 INFO [Listener at localhost/33663] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:59,057 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:59,057 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@36cdc80c{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:14:59,057 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:59,057 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2f728d8a{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:14:59,177 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-18 18:14:59,186 INFO [Listener at localhost/33663] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:14:59,187 INFO [Listener at localhost/33663] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:14:59,187 INFO [Listener at localhost/33663] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:14:59,187 INFO [Listener at localhost/33663] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:14:59,189 INFO [Listener at localhost/33663] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:14:59,189 INFO [Listener at localhost/33663] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@54e4bf8{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/java.io.tmpdir/jetty-0_0_0_0-37087-hbase-server-2_4_18-SNAPSHOT_jar-_-any-2563933280793009183/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:14:59,191 INFO [Listener at localhost/33663] server.AbstractConnector(333): Started ServerConnector@28bc48f0{HTTP/1.1, (http/1.1)}{0.0.0.0:37087} 2023-07-18 18:14:59,191 INFO [Listener at localhost/33663] server.Server(415): Started @37468ms 2023-07-18 18:14:59,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:14:59,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@2e22b53c{HTTP/1.1, (http/1.1)}{0.0.0.0:41875} 2023-07-18 18:14:59,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(415): Started @37487ms 2023-07-18 18:14:59,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:14:59,213 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:14:59,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:14:59,215 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:59,215 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:59,215 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:59,215 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:59,215 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:14:59,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:14:59,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38247,1689704098505 from backup master directory 2023-07-18 18:14:59,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:14:59,223 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:14:59,223 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:14:59,223 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:59,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:14:59,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/hbase.id with ID: 3823dae3-2394-4c4b-945c-e0915a30708a 2023-07-18 18:14:59,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:14:59,297 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:59,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x26cddbf6 to 127.0.0.1:58836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:59,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c08d992, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:59,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:59,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 18:14:59,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:59,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store-tmp 2023-07-18 18:14:59,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:59,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:14:59,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:59,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:59,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:14:59,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:59,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:14:59,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:14:59,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/WALs/jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:14:59,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38247%2C1689704098505, suffix=, logDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/WALs/jenkins-hbase4.apache.org,38247,1689704098505, archiveDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/oldWALs, maxLogs=10 2023-07-18 18:14:59,372 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK] 2023-07-18 18:14:59,372 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK] 2023-07-18 18:14:59,372 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK] 2023-07-18 18:14:59,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/WALs/jenkins-hbase4.apache.org,38247,1689704098505/jenkins-hbase4.apache.org%2C38247%2C1689704098505.1689704099351 2023-07-18 18:14:59,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK], DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK], DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK]] 2023-07-18 18:14:59,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:59,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:59,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:59,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:59,378 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:59,380 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 18:14:59,380 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 18:14:59,381 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:59,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:59,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:59,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:14:59,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:59,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11572170880, jitterRate=0.07774239778518677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:14:59,389 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:14:59,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 18:14:59,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 18:14:59,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 18:14:59,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 18:14:59,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-18 18:14:59,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-18 18:14:59,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 18:14:59,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 18:14:59,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 18:14:59,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 18:14:59,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 18:14:59,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 18:14:59,397 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:59,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 18:14:59,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 18:14:59,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 18:14:59,400 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:59,400 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:59,400 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:59,400 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:14:59,401 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:59,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38247,1689704098505, sessionid=0x10179a4edb40000, setting cluster-up flag (Was=false) 2023-07-18 18:14:59,405 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:59,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 18:14:59,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:14:59,413 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:59,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 18:14:59,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:14:59,420 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.hbase-snapshot/.tmp 2023-07-18 18:14:59,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=RSGroupAdminService 2023-07-18 18:14:59,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] rsgroup.RSGroupInfoManagerImpl(537): Refreshing in Offline mode. 2023-07-18 18:14:59,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint loaded, priority=536870911. 2023-07-18 18:14:59,425 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:59,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver loaded, priority=536870912. 2023-07-18 18:14:59,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870913. 2023-07-18 18:14:59,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 18:14:59,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 18:14:59,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 18:14:59,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 18:14:59,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 18:14:59,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:14:59,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:14:59,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:14:59,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:14:59,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 18:14:59,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:59,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689704129441 2023-07-18 18:14:59,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 18:14:59,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 18:14:59,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 18:14:59,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 18:14:59,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 18:14:59,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 18:14:59,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,442 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:14:59,442 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 18:14:59,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 18:14:59,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 18:14:59,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 18:14:59,444 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:59,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 18:14:59,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 18:14:59,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704099444,5,FailOnTimeoutGroup] 2023-07-18 18:14:59,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704099445,5,FailOnTimeoutGroup] 2023-07-18 18:14:59,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 18:14:59,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,464 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:59,465 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:59,465 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320 2023-07-18 18:14:59,477 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:59,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:14:59,480 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/info 2023-07-18 18:14:59,481 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:14:59,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:59,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:14:59,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:59,483 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:14:59,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:59,484 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:14:59,485 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/table 2023-07-18 18:14:59,485 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:14:59,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:59,486 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740 2023-07-18 18:14:59,487 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740 2023-07-18 18:14:59,489 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:14:59,490 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:14:59,492 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:14:59,492 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11128865120, jitterRate=0.036456331610679626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:14:59,492 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:14:59,492 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:14:59,492 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:14:59,492 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:14:59,492 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:14:59,492 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:14:59,493 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:14:59,493 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:14:59,493 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:14:59,493 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 18:14:59,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 18:14:59,494 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 18:14:59,496 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 18:14:59,497 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(951): ClusterId : 3823dae3-2394-4c4b-945c-e0915a30708a 2023-07-18 18:14:59,497 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(951): ClusterId : 3823dae3-2394-4c4b-945c-e0915a30708a 2023-07-18 18:14:59,497 DEBUG [RS:0;jenkins-hbase4:34463] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:14:59,497 INFO [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(951): ClusterId : 3823dae3-2394-4c4b-945c-e0915a30708a 2023-07-18 18:14:59,497 DEBUG [RS:1;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:14:59,497 DEBUG [RS:2;jenkins-hbase4:42293] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:14:59,501 DEBUG [RS:2;jenkins-hbase4:42293] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:14:59,501 DEBUG [RS:1;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:14:59,501 DEBUG [RS:1;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:14:59,501 DEBUG [RS:2;jenkins-hbase4:42293] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:14:59,501 DEBUG [RS:0;jenkins-hbase4:34463] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:14:59,501 DEBUG [RS:0;jenkins-hbase4:34463] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:14:59,503 DEBUG [RS:1;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:14:59,506 DEBUG [RS:2;jenkins-hbase4:42293] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:14:59,507 DEBUG [RS:1;jenkins-hbase4:36449] zookeeper.ReadOnlyZKClient(139): Connect 0x1cfa9bf6 to 127.0.0.1:58836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:59,507 DEBUG [RS:0;jenkins-hbase4:34463] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:14:59,507 DEBUG [RS:2;jenkins-hbase4:42293] zookeeper.ReadOnlyZKClient(139): Connect 0x3f7751bf to 127.0.0.1:58836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:59,507 DEBUG [RS:0;jenkins-hbase4:34463] zookeeper.ReadOnlyZKClient(139): Connect 0x42eb7e95 to 127.0.0.1:58836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:14:59,521 DEBUG [RS:1;jenkins-hbase4:36449] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@123d7619, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:59,521 DEBUG [RS:0;jenkins-hbase4:34463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c2c88b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:59,522 DEBUG [RS:1;jenkins-hbase4:36449] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53007c22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:14:59,522 DEBUG [RS:2;jenkins-hbase4:42293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@358f3acf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:14:59,522 DEBUG [RS:0;jenkins-hbase4:34463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d118283, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:14:59,522 DEBUG [RS:2;jenkins-hbase4:42293] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@708db21a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:14:59,532 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34463 2023-07-18 18:14:59,532 INFO [RS:0;jenkins-hbase4:34463] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:14:59,532 INFO [RS:0;jenkins-hbase4:34463] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:14:59,532 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:14:59,532 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38247,1689704098505 with isa=jenkins-hbase4.apache.org/172.31.14.131:34463, startcode=1689704098701 2023-07-18 18:14:59,533 DEBUG [RS:0;jenkins-hbase4:34463] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:14:59,534 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58593, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:14:59,536 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38247] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:14:59,536 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:59,537 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 1 2023-07-18 18:14:59,537 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36449 2023-07-18 18:14:59,537 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320 2023-07-18 18:14:59,537 DEBUG [RS:2;jenkins-hbase4:42293] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42293 2023-07-18 18:14:59,537 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34101 2023-07-18 18:14:59,537 INFO [RS:1;jenkins-hbase4:36449] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:14:59,537 INFO [RS:1;jenkins-hbase4:36449] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:14:59,537 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=43805 2023-07-18 18:14:59,537 INFO [RS:2;jenkins-hbase4:42293] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:14:59,537 INFO [RS:2;jenkins-hbase4:42293] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:14:59,537 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:14:59,537 DEBUG [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:14:59,538 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:59,539 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38247,1689704098505 with isa=jenkins-hbase4.apache.org/172.31.14.131:36449, startcode=1689704098858 2023-07-18 18:14:59,539 INFO [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38247,1689704098505 with isa=jenkins-hbase4.apache.org/172.31.14.131:42293, startcode=1689704099021 2023-07-18 18:14:59,539 DEBUG [RS:2;jenkins-hbase4:42293] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:14:59,539 DEBUG [RS:0;jenkins-hbase4:34463] zookeeper.ZKUtil(162): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:14:59,539 DEBUG [RS:1;jenkins-hbase4:36449] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:14:59,539 WARN [RS:0;jenkins-hbase4:34463] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:59,539 INFO [RS:0;jenkins-hbase4:34463] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:59,539 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:14:59,543 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50573, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:14:59,543 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59805, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:14:59,543 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38247] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,543 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:59,544 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 2 2023-07-18 18:14:59,544 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34463,1689704098701] 2023-07-18 18:14:59,544 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38247] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:14:59,545 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320 2023-07-18 18:14:59,545 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:14:59,545 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34101 2023-07-18 18:14:59,545 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=43805 2023-07-18 18:14:59,545 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 3 2023-07-18 18:14:59,545 DEBUG [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320 2023-07-18 18:14:59,545 DEBUG [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34101 2023-07-18 18:14:59,545 DEBUG [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=43805 2023-07-18 18:14:59,550 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:14:59,550 DEBUG [RS:1;jenkins-hbase4:36449] zookeeper.ZKUtil(162): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,550 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42293,1689704099021] 2023-07-18 18:14:59,550 WARN [RS:1;jenkins-hbase4:36449] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:59,550 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36449,1689704098858] 2023-07-18 18:14:59,551 INFO [RS:1;jenkins-hbase4:36449] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:59,551 DEBUG [RS:2;jenkins-hbase4:42293] zookeeper.ZKUtil(162): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:14:59,551 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,551 WARN [RS:2;jenkins-hbase4:42293] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:14:59,551 INFO [RS:2;jenkins-hbase4:42293] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:59,551 DEBUG [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:14:59,551 DEBUG [RS:0;jenkins-hbase4:34463] zookeeper.ZKUtil(162): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:14:59,551 DEBUG [RS:0;jenkins-hbase4:34463] zookeeper.ZKUtil(162): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:14:59,552 DEBUG [RS:0;jenkins-hbase4:34463] zookeeper.ZKUtil(162): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,553 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:14:59,553 INFO [RS:0;jenkins-hbase4:34463] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:14:59,555 INFO [RS:0;jenkins-hbase4:34463] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:14:59,556 INFO [RS:0;jenkins-hbase4:34463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:14:59,557 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,557 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:14:59,559 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,559 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,559 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,559 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,559 DEBUG [RS:1;jenkins-hbase4:36449] zookeeper.ZKUtil(162): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:14:59,560 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,559 DEBUG [RS:2;jenkins-hbase4:42293] zookeeper.ZKUtil(162): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:14:59,560 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,560 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:59,560 DEBUG [RS:1;jenkins-hbase4:36449] zookeeper.ZKUtil(162): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:14:59,560 DEBUG [RS:2;jenkins-hbase4:42293] zookeeper.ZKUtil(162): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:14:59,560 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,560 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,560 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,560 DEBUG [RS:2;jenkins-hbase4:42293] zookeeper.ZKUtil(162): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,560 DEBUG [RS:1;jenkins-hbase4:36449] zookeeper.ZKUtil(162): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,560 DEBUG [RS:0;jenkins-hbase4:34463] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,561 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:14:59,561 DEBUG [RS:2;jenkins-hbase4:42293] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:14:59,561 INFO [RS:1;jenkins-hbase4:36449] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:14:59,561 INFO [RS:2;jenkins-hbase4:42293] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:14:59,563 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,563 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,563 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,563 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,564 INFO [RS:1;jenkins-hbase4:36449] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:14:59,564 INFO [RS:2;jenkins-hbase4:42293] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:14:59,564 INFO [RS:1;jenkins-hbase4:36449] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:14:59,565 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,567 INFO [RS:2;jenkins-hbase4:42293] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:14:59,567 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:14:59,567 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,567 INFO [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:14:59,569 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,569 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,569 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:59,569 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,569 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,570 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,570 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:14:59,570 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,570 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,570 DEBUG [RS:1;jenkins-hbase4:36449] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,570 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,570 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,570 DEBUG [RS:2;jenkins-hbase4:42293] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:14:59,579 INFO [RS:0;jenkins-hbase4:34463] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:14:59,579 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34463,1689704098701-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,585 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,588 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,589 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,590 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,590 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,590 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,590 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,590 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,600 INFO [RS:0;jenkins-hbase4:34463] regionserver.Replication(203): jenkins-hbase4.apache.org,34463,1689704098701 started 2023-07-18 18:14:59,600 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34463,1689704098701, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34463, sessionid=0x10179a4edb40001 2023-07-18 18:14:59,600 DEBUG [RS:0;jenkins-hbase4:34463] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:14:59,600 DEBUG [RS:0;jenkins-hbase4:34463] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:14:59,600 DEBUG [RS:0;jenkins-hbase4:34463] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34463,1689704098701' 2023-07-18 18:14:59,600 DEBUG [RS:0;jenkins-hbase4:34463] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:14:59,601 DEBUG [RS:0;jenkins-hbase4:34463] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:14:59,602 DEBUG [RS:0;jenkins-hbase4:34463] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:14:59,602 DEBUG [RS:0;jenkins-hbase4:34463] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:14:59,602 DEBUG [RS:0;jenkins-hbase4:34463] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:14:59,602 DEBUG [RS:0;jenkins-hbase4:34463] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34463,1689704098701' 2023-07-18 18:14:59,602 DEBUG [RS:0;jenkins-hbase4:34463] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:14:59,602 DEBUG [RS:0;jenkins-hbase4:34463] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:14:59,603 DEBUG [RS:0;jenkins-hbase4:34463] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:14:59,603 INFO [RS:0;jenkins-hbase4:34463] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-18 18:14:59,605 INFO [RS:2;jenkins-hbase4:42293] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:14:59,605 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42293,1689704099021-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,605 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,606 DEBUG [RS:0;jenkins-hbase4:34463] zookeeper.ZKUtil(398): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-18 18:14:59,606 INFO [RS:0;jenkins-hbase4:34463] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-18 18:14:59,607 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,607 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,612 INFO [RS:1;jenkins-hbase4:36449] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:14:59,612 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36449,1689704098858-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,628 INFO [RS:2;jenkins-hbase4:42293] regionserver.Replication(203): jenkins-hbase4.apache.org,42293,1689704099021 started 2023-07-18 18:14:59,628 INFO [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42293,1689704099021, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42293, sessionid=0x10179a4edb40003 2023-07-18 18:14:59,629 INFO [RS:1;jenkins-hbase4:36449] regionserver.Replication(203): jenkins-hbase4.apache.org,36449,1689704098858 started 2023-07-18 18:14:59,629 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36449,1689704098858, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36449, sessionid=0x10179a4edb40002 2023-07-18 18:14:59,629 DEBUG [RS:2;jenkins-hbase4:42293] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:14:59,629 DEBUG [RS:1;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:14:59,629 DEBUG [RS:2;jenkins-hbase4:42293] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:14:59,629 DEBUG [RS:2;jenkins-hbase4:42293] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42293,1689704099021' 2023-07-18 18:14:59,629 DEBUG [RS:1;jenkins-hbase4:36449] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,629 DEBUG [RS:2;jenkins-hbase4:42293] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:14:59,630 DEBUG [RS:1;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36449,1689704098858' 2023-07-18 18:14:59,630 DEBUG [RS:1;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:14:59,630 DEBUG [RS:1;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:14:59,630 DEBUG [RS:2;jenkins-hbase4:42293] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:14:59,631 DEBUG [RS:1;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:14:59,631 DEBUG [RS:1;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:14:59,631 DEBUG [RS:1;jenkins-hbase4:36449] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,631 DEBUG [RS:1;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36449,1689704098858' 2023-07-18 18:14:59,631 DEBUG [RS:1;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:14:59,631 DEBUG [RS:2;jenkins-hbase4:42293] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:14:59,631 DEBUG [RS:2;jenkins-hbase4:42293] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:14:59,631 DEBUG [RS:2;jenkins-hbase4:42293] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:14:59,631 DEBUG [RS:2;jenkins-hbase4:42293] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42293,1689704099021' 2023-07-18 18:14:59,632 DEBUG [RS:2;jenkins-hbase4:42293] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:14:59,632 DEBUG [RS:1;jenkins-hbase4:36449] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:14:59,632 DEBUG [RS:2;jenkins-hbase4:42293] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:14:59,632 DEBUG [RS:1;jenkins-hbase4:36449] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:14:59,632 INFO [RS:1;jenkins-hbase4:36449] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-18 18:14:59,632 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,633 DEBUG [RS:2;jenkins-hbase4:42293] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:14:59,633 INFO [RS:2;jenkins-hbase4:42293] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2023-07-18 18:14:59,633 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,633 DEBUG [RS:1;jenkins-hbase4:36449] zookeeper.ZKUtil(398): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-18 18:14:59,633 INFO [RS:1;jenkins-hbase4:36449] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-18 18:14:59,633 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,633 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,633 DEBUG [RS:2;jenkins-hbase4:42293] zookeeper.ZKUtil(398): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2023-07-18 18:14:59,633 INFO [RS:2;jenkins-hbase4:42293] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2023-07-18 18:14:59,634 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,634 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,647 DEBUG [jenkins-hbase4:38247] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 18:14:59,647 DEBUG [jenkins-hbase4:38247] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:59,647 DEBUG [jenkins-hbase4:38247] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:59,647 DEBUG [jenkins-hbase4:38247] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:59,647 DEBUG [jenkins-hbase4:38247] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:59,647 DEBUG [jenkins-hbase4:38247] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:59,648 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36449,1689704098858, state=OPENING 2023-07-18 18:14:59,650 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 18:14:59,652 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:14:59,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36449,1689704098858}] 2023-07-18 18:14:59,653 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:59,711 INFO [RS:0;jenkins-hbase4:34463] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34463%2C1689704098701, suffix=, logDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,34463,1689704098701, archiveDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/oldWALs, maxLogs=32 2023-07-18 18:14:59,727 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK] 2023-07-18 18:14:59,727 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK] 2023-07-18 18:14:59,727 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK] 2023-07-18 18:14:59,729 INFO [RS:0;jenkins-hbase4:34463] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,34463,1689704098701/jenkins-hbase4.apache.org%2C34463%2C1689704098701.1689704099712 2023-07-18 18:14:59,729 DEBUG [RS:0;jenkins-hbase4:34463] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK], DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK], DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK]] 2023-07-18 18:14:59,732 WARN [ReadOnlyZKClient-127.0.0.1:58836@0x26cddbf6] client.ZKConnectionRegistry(168): Meta region is in state OPENING 2023-07-18 18:14:59,732 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:14:59,734 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:14:59,734 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36449] ipc.CallRunner(144): callId: 0 service: ClientService methodName: Get size: 88 connection: 172.31.14.131:42412 deadline: 1689704159734, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,735 INFO [RS:1;jenkins-hbase4:36449] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36449%2C1689704098858, suffix=, logDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,36449,1689704098858, archiveDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/oldWALs, maxLogs=32 2023-07-18 18:14:59,735 INFO [RS:2;jenkins-hbase4:42293] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42293%2C1689704099021, suffix=, logDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,42293,1689704099021, archiveDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/oldWALs, maxLogs=32 2023-07-18 18:14:59,751 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK] 2023-07-18 18:14:59,751 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK] 2023-07-18 18:14:59,751 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK] 2023-07-18 18:14:59,758 INFO [RS:1;jenkins-hbase4:36449] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,36449,1689704098858/jenkins-hbase4.apache.org%2C36449%2C1689704098858.1689704099735 2023-07-18 18:14:59,758 DEBUG [RS:1;jenkins-hbase4:36449] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK], DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK], DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK]] 2023-07-18 18:14:59,762 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK] 2023-07-18 18:14:59,763 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK] 2023-07-18 18:14:59,763 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK] 2023-07-18 18:14:59,769 INFO [RS:2;jenkins-hbase4:42293] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,42293,1689704099021/jenkins-hbase4.apache.org%2C42293%2C1689704099021.1689704099736 2023-07-18 18:14:59,770 DEBUG [RS:2;jenkins-hbase4:42293] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK], DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK], DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK]] 2023-07-18 18:14:59,806 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:14:59,807 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:14:59,809 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:14:59,813 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 18:14:59,813 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:14:59,815 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36449%2C1689704098858.meta, suffix=.meta, logDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,36449,1689704098858, archiveDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/oldWALs, maxLogs=32 2023-07-18 18:14:59,829 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK] 2023-07-18 18:14:59,829 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK] 2023-07-18 18:14:59,830 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK] 2023-07-18 18:14:59,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,36449,1689704098858/jenkins-hbase4.apache.org%2C36449%2C1689704098858.meta.1689704099815.meta 2023-07-18 18:14:59,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43299,DS-bc99861f-f050-4aaf-aa4c-16699ee5e428,DISK], DatanodeInfoWithStorage[127.0.0.1:35317,DS-d0f5449a-4098-4d29-b485-97037d6660b8,DISK], DatanodeInfoWithStorage[127.0.0.1:40679,DS-3a993805-523a-4044-acb8-8330dc629998,DISK]] 2023-07-18 18:14:59,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:14:59,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:14:59,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 18:14:59,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 18:14:59,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 18:14:59,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:59,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 18:14:59,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 18:14:59,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:14:59,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/info 2023-07-18 18:14:59,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/info 2023-07-18 18:14:59,835 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:14:59,836 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:59,836 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:14:59,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:59,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:14:59,837 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:14:59,837 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:59,838 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:14:59,838 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/table 2023-07-18 18:14:59,838 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/table 2023-07-18 18:14:59,839 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:14:59,839 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:14:59,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740 2023-07-18 18:14:59,841 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740 2023-07-18 18:14:59,843 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:14:59,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:14:59,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10866717600, jitterRate=0.012041941285133362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:14:59,845 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:14:59,846 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689704099806 2023-07-18 18:14:59,850 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 18:14:59,851 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 18:14:59,851 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36449,1689704098858, state=OPEN 2023-07-18 18:14:59,853 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:14:59,853 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:14:59,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 18:14:59,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36449,1689704098858 in 200 msec 2023-07-18 18:14:59,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 18:14:59,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-07-18 18:14:59,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 430 msec 2023-07-18 18:14:59,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689704099857, completionTime=-1 2023-07-18 18:14:59,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 18:14:59,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 18:14:59,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 18:14:59,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689704159862 2023-07-18 18:14:59,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689704219862 2023-07-18 18:14:59,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 4 msec 2023-07-18 18:14:59,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38247,1689704098505-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38247,1689704098505-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38247,1689704098505-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38247, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 18:14:59,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 18:14:59,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:14:59,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 18:14:59,871 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 18:14:59,871 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:14:59,872 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:14:59,874 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:14:59,874 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb empty. 2023-07-18 18:14:59,875 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:14:59,875 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 18:14:59,893 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 18:14:59,895 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d23c1442c2c7f56c495c93a095f3c4eb, NAME => 'hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp 2023-07-18 18:14:59,907 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:14:59,907 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d23c1442c2c7f56c495c93a095f3c4eb, disabling compactions & flushes 2023-07-18 18:14:59,907 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:14:59,907 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:14:59,907 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. after waiting 0 ms 2023-07-18 18:14:59,907 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:14:59,908 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:14:59,908 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d23c1442c2c7f56c495c93a095f3c4eb: 2023-07-18 18:14:59,910 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:14:59,911 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704099910"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704099910"}]},"ts":"1689704099910"} 2023-07-18 18:14:59,914 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:14:59,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:14:59,916 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704099915"}]},"ts":"1689704099915"} 2023-07-18 18:14:59,917 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 18:14:59,921 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:14:59,921 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:14:59,921 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:14:59,921 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:14:59,921 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:14:59,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d23c1442c2c7f56c495c93a095f3c4eb, ASSIGN}] 2023-07-18 18:14:59,923 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d23c1442c2c7f56c495c93a095f3c4eb, ASSIGN 2023-07-18 18:14:59,924 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d23c1442c2c7f56c495c93a095f3c4eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36449,1689704098858; forceNewPlan=false, retain=false 2023-07-18 18:15:00,037 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] master.HMaster(2148): Client=null/null create 'hbase:rsgroup', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|', METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'm', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:00,039 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] procedure2.ProcedureExecutor(1029): Stored pid=6, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:rsgroup 2023-07-18 18:15:00,041 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:15:00,041 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:15:00,043 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,043 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9 empty. 2023-07-18 18:15:00,044 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,044 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:rsgroup regions 2023-07-18 18:15:00,055 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/rsgroup/.tabledesc/.tableinfo.0000000001 2023-07-18 18:15:00,056 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(7675): creating {ENCODED => f93adf710ff4a74dd94f702a94eae3b9, NAME => 'hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:rsgroup', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|', METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'm', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp 2023-07-18 18:15:00,067 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(866): Instantiated hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:00,067 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1604): Closing f93adf710ff4a74dd94f702a94eae3b9, disabling compactions & flushes 2023-07-18 18:15:00,067 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1626): Closing region hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:00,067 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:00,067 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. after waiting 0 ms 2023-07-18 18:15:00,067 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:00,067 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1838): Closed hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:00,067 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1558): Region close journal for f93adf710ff4a74dd94f702a94eae3b9: 2023-07-18 18:15:00,069 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:15:00,070 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704100070"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704100070"}]},"ts":"1689704100070"} 2023-07-18 18:15:00,071 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:15:00,072 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:15:00,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:rsgroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704100072"}]},"ts":"1689704100072"} 2023-07-18 18:15:00,073 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:rsgroup, state=ENABLING in hbase:meta 2023-07-18 18:15:00,074 INFO [jenkins-hbase4:38247] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:15:00,075 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d23c1442c2c7f56c495c93a095f3c4eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:15:00,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704100075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704100075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704100075"}]},"ts":"1689704100075"} 2023-07-18 18:15:00,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=7, ppid=5, state=RUNNABLE; OpenRegionProcedure d23c1442c2c7f56c495c93a095f3c4eb, server=jenkins-hbase4.apache.org,36449,1689704098858}] 2023-07-18 18:15:00,080 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:15:00,080 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:15:00,080 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:15:00,080 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:15:00,080 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:15:00,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=8, ppid=6, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:rsgroup, region=f93adf710ff4a74dd94f702a94eae3b9, ASSIGN}] 2023-07-18 18:15:00,081 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=8, ppid=6, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:rsgroup, region=f93adf710ff4a74dd94f702a94eae3b9, ASSIGN 2023-07-18 18:15:00,081 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=8, ppid=6, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:rsgroup, region=f93adf710ff4a74dd94f702a94eae3b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34463,1689704098701; forceNewPlan=false, retain=false 2023-07-18 18:15:00,231 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:15:00,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d23c1442c2c7f56c495c93a095f3c4eb, NAME => 'hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:00,232 INFO [jenkins-hbase4:38247] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:15:00,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:15:00,233 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=8 updating hbase:meta row=f93adf710ff4a74dd94f702a94eae3b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:15:00,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:00,233 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704100233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704100233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704100233"}]},"ts":"1689704100233"} 2023-07-18 18:15:00,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:15:00,233 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:15:00,235 INFO [StoreOpener-d23c1442c2c7f56c495c93a095f3c4eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:15:00,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=9, ppid=8, state=RUNNABLE; OpenRegionProcedure f93adf710ff4a74dd94f702a94eae3b9, server=jenkins-hbase4.apache.org,34463,1689704098701}] 2023-07-18 18:15:00,236 DEBUG [StoreOpener-d23c1442c2c7f56c495c93a095f3c4eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb/info 2023-07-18 18:15:00,237 DEBUG [StoreOpener-d23c1442c2c7f56c495c93a095f3c4eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb/info 2023-07-18 18:15:00,237 INFO [StoreOpener-d23c1442c2c7f56c495c93a095f3c4eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d23c1442c2c7f56c495c93a095f3c4eb columnFamilyName info 2023-07-18 18:15:00,238 INFO [StoreOpener-d23c1442c2c7f56c495c93a095f3c4eb-1] regionserver.HStore(310): Store=d23c1442c2c7f56c495c93a095f3c4eb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:00,239 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:15:00,239 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:15:00,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:15:00,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:00,244 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d23c1442c2c7f56c495c93a095f3c4eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10568276000, jitterRate=-0.015752598643302917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:15:00,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d23c1442c2c7f56c495c93a095f3c4eb: 2023-07-18 18:15:00,245 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb., pid=7, masterSystemTime=1689704100228 2023-07-18 18:15:00,247 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:15:00,247 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:15:00,247 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d23c1442c2c7f56c495c93a095f3c4eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:15:00,248 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704100247"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704100247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704100247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704100247"}]},"ts":"1689704100247"} 2023-07-18 18:15:00,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=7, resume processing ppid=5 2023-07-18 18:15:00,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, ppid=5, state=SUCCESS; OpenRegionProcedure d23c1442c2c7f56c495c93a095f3c4eb, server=jenkins-hbase4.apache.org,36449,1689704098858 in 173 msec 2023-07-18 18:15:00,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 18:15:00,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d23c1442c2c7f56c495c93a095f3c4eb, ASSIGN in 329 msec 2023-07-18 18:15:00,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:15:00,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704100252"}]},"ts":"1689704100252"} 2023-07-18 18:15:00,253 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 18:15:00,255 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:15:00,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 387 msec 2023-07-18 18:15:00,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 18:15:00,272 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:00,272 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:00,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 18:15:00,284 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:00,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-07-18 18:15:00,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=11, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 18:15:00,299 DEBUG [PEWorker-1] procedure.MasterProcedureScheduler(526): NAMESPACE 'hbase', shared lock count=1 2023-07-18 18:15:00,299 DEBUG [PEWorker-1] procedure2.ProcedureExecutor(1400): LOCK_EVENT_WAIT pid=11, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 18:15:00,388 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:15:00,388 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:15:00,389 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:15:00,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:00,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f93adf710ff4a74dd94f702a94eae3b9, NAME => 'hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:00,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:15:00,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. service=MultiRowMutationService 2023-07-18 18:15:00,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:rsgroup successfully. 2023-07-18 18:15:00,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table rsgroup f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:00,394 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,395 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,396 INFO [StoreOpener-f93adf710ff4a74dd94f702a94eae3b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family m of region f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,397 DEBUG [StoreOpener-f93adf710ff4a74dd94f702a94eae3b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9/m 2023-07-18 18:15:00,397 DEBUG [StoreOpener-f93adf710ff4a74dd94f702a94eae3b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9/m 2023-07-18 18:15:00,397 INFO [StoreOpener-f93adf710ff4a74dd94f702a94eae3b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f93adf710ff4a74dd94f702a94eae3b9 columnFamilyName m 2023-07-18 18:15:00,398 INFO [StoreOpener-f93adf710ff4a74dd94f702a94eae3b9-1] regionserver.HStore(310): Store=f93adf710ff4a74dd94f702a94eae3b9/m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:00,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,401 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:00,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:00,404 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f93adf710ff4a74dd94f702a94eae3b9; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@3c78dc3b, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:15:00,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f93adf710ff4a74dd94f702a94eae3b9: 2023-07-18 18:15:00,405 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9., pid=9, masterSystemTime=1689704100388 2023-07-18 18:15:00,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:00,409 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:00,409 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=8 updating hbase:meta row=f93adf710ff4a74dd94f702a94eae3b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:15:00,409 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704100409"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704100409"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704100409"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704100409"}]},"ts":"1689704100409"} 2023-07-18 18:15:00,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=9, resume processing ppid=8 2023-07-18 18:15:00,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, ppid=8, state=SUCCESS; OpenRegionProcedure f93adf710ff4a74dd94f702a94eae3b9, server=jenkins-hbase4.apache.org,34463,1689704098701 in 175 msec 2023-07-18 18:15:00,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=8, resume processing ppid=6 2023-07-18 18:15:00,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, ppid=6, state=SUCCESS; TransitRegionStateProcedure table=hbase:rsgroup, region=f93adf710ff4a74dd94f702a94eae3b9, ASSIGN in 332 msec 2023-07-18 18:15:00,421 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:00,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 125 msec 2023-07-18 18:15:00,425 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:15:00,425 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:rsgroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704100425"}]},"ts":"1689704100425"} 2023-07-18 18:15:00,426 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:rsgroup, state=ENABLED in hbase:meta 2023-07-18 18:15:00,429 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=6, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:15:00,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, state=SUCCESS; CreateTableProcedure table=hbase:rsgroup in 393 msec 2023-07-18 18:15:00,433 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 18:15:00,437 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 18:15:00,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.214sec 2023-07-18 18:15:00,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2023-07-18 18:15:00,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:00,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2023-07-18 18:15:00,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2023-07-18 18:15:00,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2023-07-18 18:15:00,442 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:15:00,443 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:15:00,444 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:15:00,444 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:15:00,447 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker(840): RSGroup table=hbase:rsgroup is online, refreshing cached information 2023-07-18 18:15:00,447 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl(534): Refreshing in Online mode. 2023-07-18 18:15:00,448 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,448 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81 empty. 2023-07-18 18:15:00,449 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,449 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2023-07-18 18:15:00,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2023-07-18 18:15:00,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2023-07-18 18:15:00,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:00,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:00,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 18:15:00,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 18:15:00,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38247,1689704098505-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 18:15:00,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38247,1689704098505-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 18:15:00,456 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:00,456 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:00,458 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 2 2023-07-18 18:15:00,459 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,38247,1689704098505] rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker(823): GroupBasedLoadBalancer is now online 2023-07-18 18:15:00,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 18:15:00,473 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2023-07-18 18:15:00,474 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => fed2bb38e1ebd2d3e8c30278900a3f81, NAME => 'hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp 2023-07-18 18:15:00,494 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:00,494 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing fed2bb38e1ebd2d3e8c30278900a3f81, disabling compactions & flushes 2023-07-18 18:15:00,494 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:00,494 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:00,494 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. after waiting 0 ms 2023-07-18 18:15:00,494 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:00,494 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:00,494 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for fed2bb38e1ebd2d3e8c30278900a3f81: 2023-07-18 18:15:00,496 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:15:00,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689704100497"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704100497"}]},"ts":"1689704100497"} 2023-07-18 18:15:00,498 ERROR [Listener at localhost/33663] master.TableStateManager(95): Unable to get table hbase:quota state org.apache.hadoop.hbase.TableNotFoundException: No state found for hbase:quota at org.apache.hadoop.hbase.master.TableStateManager.getTableState(TableStateManager.java:155) at org.apache.hadoop.hbase.master.TableStateManager.isTableState(TableStateManager.java:92) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.isTableDisabled(AssignmentManager.java:419) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.getRegionStatesCount(AssignmentManager.java:2341) at org.apache.hadoop.hbase.master.HMaster.getClusterMetricsWithoutCoprocessor(HMaster.java:2616) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2640) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2633) at org.apache.hadoop.hbase.MiniHBaseCluster.getClusterMetrics(MiniHBaseCluster.java:710) at org.apache.hadoop.hbase.MiniHBaseCluster.(MiniHBaseCluster.java:111) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1131) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1094) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.toggleQuotaCheckAndRestartMiniCluster(TestRSGroupsAdmin1.java:492) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.testRSGroupListDoesNotContainFailedTableCreation(TestRSGroupsAdmin1.java:410) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:15:00,499 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:15:00,499 DEBUG [Listener at localhost/33663] zookeeper.ReadOnlyZKClient(139): Connect 0x06a1b9d4 to 127.0.0.1:58836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:00,501 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:15:00,501 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704100501"}]},"ts":"1689704100501"} 2023-07-18 18:15:00,502 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2023-07-18 18:15:00,508 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:15:00,508 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:15:00,509 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:15:00,509 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:15:00,509 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:15:00,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=fed2bb38e1ebd2d3e8c30278900a3f81, ASSIGN}] 2023-07-18 18:15:00,511 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=fed2bb38e1ebd2d3e8c30278900a3f81, ASSIGN 2023-07-18 18:15:00,512 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=fed2bb38e1ebd2d3e8c30278900a3f81, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36449,1689704098858; forceNewPlan=false, retain=false 2023-07-18 18:15:00,523 DEBUG [Listener at localhost/33663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b7167b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:00,532 DEBUG [hconnection-0x1c97e0aa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:15:00,536 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:15:00,538 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:15:00,538 INFO [Listener at localhost/33663] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:00,544 DEBUG [Listener at localhost/33663] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 18:15:00,546 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 18:15:00,550 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-18 18:15:00,550 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:00,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(492): Client=jenkins//172.31.14.131 set balanceSwitch=false 2023-07-18 18:15:00,552 DEBUG [Listener at localhost/33663] zookeeper.ReadOnlyZKClient(139): Connect 0x34a7cc7e to 127.0.0.1:58836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:00,558 DEBUG [Listener at localhost/33663] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1796f8f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:00,559 INFO [Listener at localhost/33663] zookeeper.RecoverableZooKeeper(93): Process identifier=VerifyingRSGroupAdminClient connecting to ZooKeeper ensemble=127.0.0.1:58836 2023-07-18 18:15:00,566 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): VerifyingRSGroupAdminClient0x0, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:15:00,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): VerifyingRSGroupAdminClient-0x10179a4edb4000a connected 2023-07-18 18:15:00,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'np1', hbase.namespace.quota.maxregions => '5', hbase.namespace.quota.maxtables => '2'} 2023-07-18 18:15:00,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=np1 2023-07-18 18:15:00,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=14 2023-07-18 18:15:00,585 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:00,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; CreateNamespaceProcedure, namespace=np1 in 15 msec 2023-07-18 18:15:00,663 INFO [jenkins-hbase4:38247] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:15:00,664 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=fed2bb38e1ebd2d3e8c30278900a3f81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:15:00,664 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689704100664"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704100664"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704100664"}]},"ts":"1689704100664"} 2023-07-18 18:15:00,666 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure fed2bb38e1ebd2d3e8c30278900a3f81, server=jenkins-hbase4.apache.org,36449,1689704098858}] 2023-07-18 18:15:00,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=14 2023-07-18 18:15:00,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'np1:table1', {NAME => 'fam1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:00,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] procedure2.ProcedureExecutor(1029): Stored pid=16, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=np1:table1 2023-07-18 18:15:00,689 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=16, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=np1:table1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:15:00,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "np1" qualifier: "table1" procId is: 16 2023-07-18 18:15:00,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-18 18:15:00,691 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:00,692 DEBUG [PEWorker-2] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 2 2023-07-18 18:15:00,694 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=16, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=np1:table1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:15:00,696 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:00,697 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999 empty. 2023-07-18 18:15:00,697 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:00,697 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived np1:table1 regions 2023-07-18 18:15:00,724 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/.tabledesc/.tableinfo.0000000001 2023-07-18 18:15:00,726 INFO [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 02704d5fb0f18a92e08b2dac364d2999, NAME => 'np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='np1:table1', {NAME => 'fam1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp 2023-07-18 18:15:00,737 DEBUG [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(866): Instantiated np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:00,737 DEBUG [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(1604): Closing 02704d5fb0f18a92e08b2dac364d2999, disabling compactions & flushes 2023-07-18 18:15:00,737 INFO [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(1626): Closing region np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:00,737 DEBUG [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:00,737 DEBUG [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(1714): Acquired close lock on np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. after waiting 0 ms 2023-07-18 18:15:00,737 DEBUG [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(1724): Updates disabled for region np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:00,737 INFO [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(1838): Closed np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:00,737 DEBUG [RegionOpenAndInit-np1:table1-pool-0] regionserver.HRegion(1558): Region close journal for 02704d5fb0f18a92e08b2dac364d2999: 2023-07-18 18:15:00,740 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=16, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=np1:table1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:15:00,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704100741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704100741"}]},"ts":"1689704100741"} 2023-07-18 18:15:00,743 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:15:00,743 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=16, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=np1:table1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:15:00,744 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"np1:table1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704100743"}]},"ts":"1689704100743"} 2023-07-18 18:15:00,745 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=np1:table1, state=ENABLING in hbase:meta 2023-07-18 18:15:00,748 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:15:00,749 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:15:00,749 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:15:00,749 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:15:00,749 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:15:00,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=np1:table1, region=02704d5fb0f18a92e08b2dac364d2999, ASSIGN}] 2023-07-18 18:15:00,750 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=np1:table1, region=02704d5fb0f18a92e08b2dac364d2999, ASSIGN 2023-07-18 18:15:00,751 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=np1:table1, region=02704d5fb0f18a92e08b2dac364d2999, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42293,1689704099021; forceNewPlan=false, retain=false 2023-07-18 18:15:00,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-18 18:15:00,821 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:00,821 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fed2bb38e1ebd2d3e8c30278900a3f81, NAME => 'hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:00,821 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:00,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,823 INFO [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,824 DEBUG [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81/q 2023-07-18 18:15:00,824 DEBUG [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81/q 2023-07-18 18:15:00,825 INFO [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fed2bb38e1ebd2d3e8c30278900a3f81 columnFamilyName q 2023-07-18 18:15:00,825 INFO [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] regionserver.HStore(310): Store=fed2bb38e1ebd2d3e8c30278900a3f81/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:00,826 INFO [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,827 DEBUG [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81/u 2023-07-18 18:15:00,827 DEBUG [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81/u 2023-07-18 18:15:00,827 INFO [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fed2bb38e1ebd2d3e8c30278900a3f81 columnFamilyName u 2023-07-18 18:15:00,828 INFO [StoreOpener-fed2bb38e1ebd2d3e8c30278900a3f81-1] regionserver.HStore(310): Store=fed2bb38e1ebd2d3e8c30278900a3f81/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:00,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,831 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-18 18:15:00,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:00,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:00,834 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fed2bb38e1ebd2d3e8c30278900a3f81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11891887680, jitterRate=0.10751834511756897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-18 18:15:00,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fed2bb38e1ebd2d3e8c30278900a3f81: 2023-07-18 18:15:00,835 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81., pid=15, masterSystemTime=1689704100817 2023-07-18 18:15:00,836 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:00,837 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:00,837 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=fed2bb38e1ebd2d3e8c30278900a3f81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:15:00,837 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1689704100837"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704100837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704100837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704100837"}]},"ts":"1689704100837"} 2023-07-18 18:15:00,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-18 18:15:00,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure fed2bb38e1ebd2d3e8c30278900a3f81, server=jenkins-hbase4.apache.org,36449,1689704098858 in 172 msec 2023-07-18 18:15:00,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-18 18:15:00,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=fed2bb38e1ebd2d3e8c30278900a3f81, ASSIGN in 331 msec 2023-07-18 18:15:00,842 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:15:00,842 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704100842"}]},"ts":"1689704100842"} 2023-07-18 18:15:00,843 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2023-07-18 18:15:00,846 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:15:00,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=hbase:quota in 409 msec 2023-07-18 18:15:00,901 INFO [jenkins-hbase4:38247] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:15:00,903 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=02704d5fb0f18a92e08b2dac364d2999, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:15:00,903 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704100903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704100903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704100903"}]},"ts":"1689704100903"} 2023-07-18 18:15:00,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=17, state=RUNNABLE; OpenRegionProcedure 02704d5fb0f18a92e08b2dac364d2999, server=jenkins-hbase4.apache.org,42293,1689704099021}] 2023-07-18 18:15:00,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-18 18:15:01,058 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:15:01,059 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:15:01,060 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:15:01,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:01,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02704d5fb0f18a92e08b2dac364d2999, NAME => 'np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:01,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table table1 02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:01,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,068 INFO [StoreOpener-02704d5fb0f18a92e08b2dac364d2999-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family fam1 of region 02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,069 DEBUG [StoreOpener-02704d5fb0f18a92e08b2dac364d2999-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999/fam1 2023-07-18 18:15:01,070 DEBUG [StoreOpener-02704d5fb0f18a92e08b2dac364d2999-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999/fam1 2023-07-18 18:15:01,070 INFO [StoreOpener-02704d5fb0f18a92e08b2dac364d2999-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02704d5fb0f18a92e08b2dac364d2999 columnFamilyName fam1 2023-07-18 18:15:01,071 INFO [StoreOpener-02704d5fb0f18a92e08b2dac364d2999-1] regionserver.HStore(310): Store=02704d5fb0f18a92e08b2dac364d2999/fam1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:01,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:01,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 02704d5fb0f18a92e08b2dac364d2999; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=9899864160, jitterRate=-0.07800330221652985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:15:01,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 02704d5fb0f18a92e08b2dac364d2999: 2023-07-18 18:15:01,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999., pid=18, masterSystemTime=1689704101058 2023-07-18 18:15:01,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:01,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:01,086 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=02704d5fb0f18a92e08b2dac364d2999, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:15:01,086 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704101086"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704101086"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704101086"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704101086"}]},"ts":"1689704101086"} 2023-07-18 18:15:01,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=17 2023-07-18 18:15:01,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=17, state=SUCCESS; OpenRegionProcedure 02704d5fb0f18a92e08b2dac364d2999, server=jenkins-hbase4.apache.org,42293,1689704099021 in 182 msec 2023-07-18 18:15:01,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-18 18:15:01,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; TransitRegionStateProcedure table=np1:table1, region=02704d5fb0f18a92e08b2dac364d2999, ASSIGN in 340 msec 2023-07-18 18:15:01,092 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=16, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=np1:table1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:15:01,092 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"np1:table1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704101092"}]},"ts":"1689704101092"} 2023-07-18 18:15:01,093 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=np1:table1, state=ENABLED in hbase:meta 2023-07-18 18:15:01,096 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=16, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=np1:table1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:15:01,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, state=SUCCESS; CreateTableProcedure table=np1:table1 in 411 msec 2023-07-18 18:15:01,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-18 18:15:01,295 INFO [Listener at localhost/33663] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: np1:table1, procId: 16 completed 2023-07-18 18:15:01,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'np1:table2', {NAME => 'fam1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:01,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=np1:table2 2023-07-18 18:15:01,300 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=np1:table2 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:15:01,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "np1" qualifier: "table2" procId is: 19 2023-07-18 18:15:01,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-18 18:15:01,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1528): Rolled back pid=19, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.quotas.QuotaExceededException via master-create-table:org.apache.hadoop.hbase.quotas.QuotaExceededException: The table np1:table2 is not allowed to have 6 regions. The total number of regions permitted is only 5, while current region count is 1. This may be transient, please retry later if there are any ongoing split operations in the namespace.; CreateTableProcedure table=np1:table2 exec-time=30 msec 2023-07-18 18:15:01,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-18 18:15:01,412 INFO [Listener at localhost/33663] client.HBaseAdmin$TableFuture(3548): Operation: CREATE, Table Name: np1:table2, procId: 19 failed with The table np1:table2 is not allowed to have 6 regions. The total number of regions permitted is only 5, while current region count is 1. This may be transient, please retry later if there are any ongoing split operations in the namespace. 2023-07-18 18:15:01,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:01,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:01,415 INFO [Listener at localhost/33663] client.HBaseAdmin$15(890): Started disable of np1:table1 2023-07-18 18:15:01,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable np1:table1 2023-07-18 18:15:01,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=np1:table1 2023-07-18 18:15:01,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=20 2023-07-18 18:15:01,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"np1:table1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704101420"}]},"ts":"1689704101420"} 2023-07-18 18:15:01,422 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=np1:table1, state=DISABLING in hbase:meta 2023-07-18 18:15:01,424 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set np1:table1 to state=DISABLING 2023-07-18 18:15:01,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=np1:table1, region=02704d5fb0f18a92e08b2dac364d2999, UNASSIGN}] 2023-07-18 18:15:01,431 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=21, ppid=20, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=np1:table1, region=02704d5fb0f18a92e08b2dac364d2999, UNASSIGN 2023-07-18 18:15:01,432 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=02704d5fb0f18a92e08b2dac364d2999, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:15:01,432 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704101431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704101431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704101431"}]},"ts":"1689704101431"} 2023-07-18 18:15:01,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE; CloseRegionProcedure 02704d5fb0f18a92e08b2dac364d2999, server=jenkins-hbase4.apache.org,42293,1689704099021}] 2023-07-18 18:15:01,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=20 2023-07-18 18:15:01,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 02704d5fb0f18a92e08b2dac364d2999, disabling compactions & flushes 2023-07-18 18:15:01,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:01,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:01,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. after waiting 0 ms 2023-07-18 18:15:01,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:01,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:15:01,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999. 2023-07-18 18:15:01,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 02704d5fb0f18a92e08b2dac364d2999: 2023-07-18 18:15:01,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,597 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=21 updating hbase:meta row=02704d5fb0f18a92e08b2dac364d2999, regionState=CLOSED 2023-07-18 18:15:01,597 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704101597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704101597"}]},"ts":"1689704101597"} 2023-07-18 18:15:01,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-18 18:15:01,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; CloseRegionProcedure 02704d5fb0f18a92e08b2dac364d2999, server=jenkins-hbase4.apache.org,42293,1689704099021 in 163 msec 2023-07-18 18:15:01,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-07-18 18:15:01,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; TransitRegionStateProcedure table=np1:table1, region=02704d5fb0f18a92e08b2dac364d2999, UNASSIGN in 177 msec 2023-07-18 18:15:01,607 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"np1:table1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704101607"}]},"ts":"1689704101607"} 2023-07-18 18:15:01,609 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=np1:table1, state=DISABLED in hbase:meta 2023-07-18 18:15:01,616 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set np1:table1 to state=DISABLED 2023-07-18 18:15:01,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; DisableTableProcedure table=np1:table1 in 201 msec 2023-07-18 18:15:01,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=20 2023-07-18 18:15:01,722 INFO [Listener at localhost/33663] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: np1:table1, procId: 20 completed 2023-07-18 18:15:01,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete np1:table1 2023-07-18 18:15:01,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=np1:table1 2023-07-18 18:15:01,726 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=23, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=np1:table1 2023-07-18 18:15:01,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] rsgroup.RSGroupAdminEndpoint(577): Removing deleted table 'np1:table1' from rsgroup 'default' 2023-07-18 18:15:01,727 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=23, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=np1:table1 2023-07-18 18:15:01,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:01,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 2 2023-07-18 18:15:01,732 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-18 18:15:01,734 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999/fam1, FileablePath, hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999/recovered.edits] 2023-07-18 18:15:01,740 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999/recovered.edits/4.seqid to hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/archive/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999/recovered.edits/4.seqid 2023-07-18 18:15:01,740 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/.tmp/data/np1/table1/02704d5fb0f18a92e08b2dac364d2999 2023-07-18 18:15:01,740 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived np1:table1 regions 2023-07-18 18:15:01,743 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=23, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=np1:table1 2023-07-18 18:15:01,744 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of np1:table1 from hbase:meta 2023-07-18 18:15:01,746 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'np1:table1' descriptor. 2023-07-18 18:15:01,747 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=23, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=np1:table1 2023-07-18 18:15:01,747 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'np1:table1' from region states. 2023-07-18 18:15:01,748 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704101747"}]},"ts":"9223372036854775807"} 2023-07-18 18:15:01,749 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 18:15:01,749 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 02704d5fb0f18a92e08b2dac364d2999, NAME => 'np1:table1,,1689704100685.02704d5fb0f18a92e08b2dac364d2999.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 18:15:01,749 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'np1:table1' as deleted. 2023-07-18 18:15:01,749 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"np1:table1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689704101749"}]},"ts":"9223372036854775807"} 2023-07-18 18:15:01,751 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table np1:table1 state from META 2023-07-18 18:15:01,754 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=23, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=np1:table1 2023-07-18 18:15:01,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; DeleteTableProcedure table=np1:table1 in 31 msec 2023-07-18 18:15:01,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-07-18 18:15:01,834 INFO [Listener at localhost/33663] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: np1:table1, procId: 23 completed 2023-07-18 18:15:01,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.HMaster$17(3086): Client=jenkins//172.31.14.131 delete np1 2023-07-18 18:15:01,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] procedure2.ProcedureExecutor(1029): Stored pid=24, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=np1 2023-07-18 18:15:01,847 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=24, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=np1 2023-07-18 18:15:01,850 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=24, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=np1 2023-07-18 18:15:01,853 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=24, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=np1 2023-07-18 18:15:01,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-18 18:15:01,855 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/np1 2023-07-18 18:15:01,855 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:01,856 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=24, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=np1 2023-07-18 18:15:01,858 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=24, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=np1 2023-07-18 18:15:01,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, state=SUCCESS; DeleteNamespaceProcedure, namespace=np1 in 19 msec 2023-07-18 18:15:01,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38247] master.MasterRpcServices(1230): Checking to see if procedure is done pid=24 2023-07-18 18:15:01,955 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 18:15:01,955 INFO [Listener at localhost/33663] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 18:15:01,955 DEBUG [Listener at localhost/33663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06a1b9d4 to 127.0.0.1:58836 2023-07-18 18:15:01,955 DEBUG [Listener at localhost/33663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:01,955 DEBUG [Listener at localhost/33663] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 18:15:01,955 DEBUG [Listener at localhost/33663] util.JVMClusterUtil(257): Found active master hash=2147373077, stopped=false 2023-07-18 18:15:01,955 DEBUG [Listener at localhost/33663] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint 2023-07-18 18:15:01,955 DEBUG [Listener at localhost/33663] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver 2023-07-18 18:15:01,955 DEBUG [Listener at localhost/33663] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2023-07-18 18:15:01,955 INFO [Listener at localhost/33663] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:15:01,958 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:01,958 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:01,958 INFO [Listener at localhost/33663] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 18:15:01,958 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:01,958 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:01,958 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:01,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:01,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:01,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:01,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:01,962 DEBUG [Listener at localhost/33663] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26cddbf6 to 127.0.0.1:58836 2023-07-18 18:15:01,963 DEBUG [Listener at localhost/33663] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:01,963 INFO [Listener at localhost/33663] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34463,1689704098701' ***** 2023-07-18 18:15:01,963 INFO [Listener at localhost/33663] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:15:01,963 INFO [Listener at localhost/33663] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36449,1689704098858' ***** 2023-07-18 18:15:01,963 INFO [Listener at localhost/33663] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:15:01,963 INFO [Listener at localhost/33663] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42293,1689704099021' ***** 2023-07-18 18:15:01,963 INFO [Listener at localhost/33663] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:15:01,963 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:01,963 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:01,963 INFO [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:01,967 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:01,967 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:15:01,975 INFO [RS:1;jenkins-hbase4:36449] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@1fa6830d{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:01,975 INFO [RS:2;jenkins-hbase4:42293] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@54e4bf8{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:01,975 INFO [RS:0;jenkins-hbase4:34463] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@59f5ce37{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:01,975 INFO [RS:1;jenkins-hbase4:36449] server.AbstractConnector(383): Stopped ServerConnector@1a24290f{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:01,975 INFO [RS:2;jenkins-hbase4:42293] server.AbstractConnector(383): Stopped ServerConnector@28bc48f0{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:01,975 INFO [RS:0;jenkins-hbase4:34463] server.AbstractConnector(383): Stopped ServerConnector@23cf60b9{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:01,976 INFO [RS:2;jenkins-hbase4:42293] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:01,976 INFO [RS:1;jenkins-hbase4:36449] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:01,976 INFO [RS:0;jenkins-hbase4:34463] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:01,977 INFO [RS:2;jenkins-hbase4:42293] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2f728d8a{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:01,979 INFO [RS:1;jenkins-hbase4:36449] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@321cd692{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:01,979 INFO [RS:0;jenkins-hbase4:34463] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@204cfa25{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:01,979 INFO [RS:1;jenkins-hbase4:36449] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@30ad32c0{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:01,979 INFO [RS:2;jenkins-hbase4:42293] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@36cdc80c{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:01,979 INFO [RS:0;jenkins-hbase4:34463] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@3ee8c6a2{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:01,983 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:15:01,985 INFO [RS:2;jenkins-hbase4:42293] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:15:01,986 INFO [RS:2;jenkins-hbase4:42293] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:15:01,986 INFO [RS:2;jenkins-hbase4:42293] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:15:01,986 INFO [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:15:01,986 INFO [RS:1;jenkins-hbase4:36449] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:15:01,986 DEBUG [RS:2;jenkins-hbase4:42293] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f7751bf to 127.0.0.1:58836 2023-07-18 18:15:01,986 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:15:01,986 DEBUG [RS:2;jenkins-hbase4:42293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:01,987 INFO [RS:0;jenkins-hbase4:34463] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:15:01,986 INFO [RS:1;jenkins-hbase4:36449] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:15:01,988 INFO [RS:0;jenkins-hbase4:34463] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:15:01,987 INFO [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42293,1689704099021; all regions closed. 2023-07-18 18:15:01,988 INFO [RS:0;jenkins-hbase4:34463] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:15:01,988 INFO [RS:1;jenkins-hbase4:36449] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:15:01,988 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(3305): Received CLOSE for f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:01,988 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(3305): Received CLOSE for fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:01,988 DEBUG [RS:2;jenkins-hbase4:42293] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-18 18:15:01,995 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:15:01,995 DEBUG [RS:0;jenkins-hbase4:34463] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42eb7e95 to 127.0.0.1:58836 2023-07-18 18:15:01,995 DEBUG [RS:0;jenkins-hbase4:34463] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:01,996 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(3305): Received CLOSE for d23c1442c2c7f56c495c93a095f3c4eb 2023-07-18 18:15:01,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f93adf710ff4a74dd94f702a94eae3b9, disabling compactions & flushes 2023-07-18 18:15:01,999 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:15:01,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:01,999 DEBUG [RS:1;jenkins-hbase4:36449] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cfa9bf6 to 127.0.0.1:58836 2023-07-18 18:15:01,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fed2bb38e1ebd2d3e8c30278900a3f81, disabling compactions & flushes 2023-07-18 18:15:01,996 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 18:15:01,999 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1478): Online Regions={f93adf710ff4a74dd94f702a94eae3b9=hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9.} 2023-07-18 18:15:01,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:01,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:01,999 DEBUG [RS:1;jenkins-hbase4:36449] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:01,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:01,999 INFO [RS:1;jenkins-hbase4:36449] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:15:02,000 INFO [RS:1;jenkins-hbase4:36449] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:15:02,000 INFO [RS:1;jenkins-hbase4:36449] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:15:01,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. after waiting 0 ms 2023-07-18 18:15:01,999 DEBUG [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1504): Waiting on f93adf710ff4a74dd94f702a94eae3b9 2023-07-18 18:15:02,001 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:02,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:02,000 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 18:15:01,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. after waiting 0 ms 2023-07-18 18:15:02,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:02,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f93adf710ff4a74dd94f702a94eae3b9 1/1 column families, dataSize=585 B heapSize=1.04 KB 2023-07-18 18:15:02,006 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-18 18:15:02,007 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1478): Online Regions={fed2bb38e1ebd2d3e8c30278900a3f81=hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81., 1588230740=hbase:meta,,1.1588230740, d23c1442c2c7f56c495c93a095f3c4eb=hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb.} 2023-07-18 18:15:02,007 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1504): Waiting on 1588230740, d23c1442c2c7f56c495c93a095f3c4eb, fed2bb38e1ebd2d3e8c30278900a3f81 2023-07-18 18:15:02,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:15:02,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:15:02,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:15:02,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:15:02,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:15:02,008 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:02,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=5.89 KB heapSize=11.09 KB 2023-07-18 18:15:02,017 DEBUG [RS:2;jenkins-hbase4:42293] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/oldWALs 2023-07-18 18:15:02,017 INFO [RS:2;jenkins-hbase4:42293] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42293%2C1689704099021:(num 1689704099736) 2023-07-18 18:15:02,017 DEBUG [RS:2;jenkins-hbase4:42293] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:02,017 INFO [RS:2;jenkins-hbase4:42293] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:02,017 INFO [RS:2;jenkins-hbase4:42293] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 18:15:02,018 INFO [RS:2;jenkins-hbase4:42293] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:15:02,018 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:02,018 INFO [RS:2;jenkins-hbase4:42293] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:15:02,018 INFO [RS:2;jenkins-hbase4:42293] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:15:02,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/quota/fed2bb38e1ebd2d3e8c30278900a3f81/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:15:02,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:02,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fed2bb38e1ebd2d3e8c30278900a3f81: 2023-07-18 18:15:02,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1689704100437.fed2bb38e1ebd2d3e8c30278900a3f81. 2023-07-18 18:15:02,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d23c1442c2c7f56c495c93a095f3c4eb, disabling compactions & flushes 2023-07-18 18:15:02,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:15:02,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:15:02,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. after waiting 0 ms 2023-07-18 18:15:02,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:15:02,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d23c1442c2c7f56c495c93a095f3c4eb 1/1 column families, dataSize=215 B heapSize=776 B 2023-07-18 18:15:02,031 INFO [RS:2;jenkins-hbase4:42293] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42293 2023-07-18 18:15:02,033 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:15:02,033 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:02,033 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:02,033 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:15:02,033 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:02,033 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42293,1689704099021 2023-07-18 18:15:02,033 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:02,034 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42293,1689704099021] 2023-07-18 18:15:02,034 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42293,1689704099021; numProcessing=1 2023-07-18 18:15:02,039 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42293,1689704099021 already deleted, retry=false 2023-07-18 18:15:02,039 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42293,1689704099021 expired; onlineServers=2 2023-07-18 18:15:02,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=585 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9/.tmp/m/803bcb9d9c314aa2bb716eea27bcead1 2023-07-18 18:15:02,075 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=5.26 KB at sequenceid=31 (bloomFilter=false), to=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/.tmp/info/0b79a5f47b804067862365d71626d21e 2023-07-18 18:15:02,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=215 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb/.tmp/info/59ffb29b54d345139ae6f0856ad05c1e 2023-07-18 18:15:02,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b79a5f47b804067862365d71626d21e 2023-07-18 18:15:02,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9/.tmp/m/803bcb9d9c314aa2bb716eea27bcead1 as hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9/m/803bcb9d9c314aa2bb716eea27bcead1 2023-07-18 18:15:02,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59ffb29b54d345139ae6f0856ad05c1e 2023-07-18 18:15:02,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9/m/803bcb9d9c314aa2bb716eea27bcead1, entries=1, sequenceid=7, filesize=4.9 K 2023-07-18 18:15:02,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb/.tmp/info/59ffb29b54d345139ae6f0856ad05c1e as hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb/info/59ffb29b54d345139ae6f0856ad05c1e 2023-07-18 18:15:02,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~585 B/585, heapSize ~1.02 KB/1048, currentSize=0 B/0 for f93adf710ff4a74dd94f702a94eae3b9 in 98ms, sequenceid=7, compaction requested=false 2023-07-18 18:15:02,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:rsgroup' 2023-07-18 18:15:02,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59ffb29b54d345139ae6f0856ad05c1e 2023-07-18 18:15:02,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb/info/59ffb29b54d345139ae6f0856ad05c1e, entries=3, sequenceid=8, filesize=5.0 K 2023-07-18 18:15:02,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~215 B/215, heapSize ~760 B/760, currentSize=0 B/0 for d23c1442c2c7f56c495c93a095f3c4eb in 88ms, sequenceid=8, compaction requested=false 2023-07-18 18:15:02,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 18:15:02,131 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=90 B at sequenceid=31 (bloomFilter=false), to=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/.tmp/rep_barrier/c8ab57ef3c304060a36aefb04d3f2016 2023-07-18 18:15:02,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/rsgroup/f93adf710ff4a74dd94f702a94eae3b9/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-07-18 18:15:02,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:15:02,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:02,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f93adf710ff4a74dd94f702a94eae3b9: 2023-07-18 18:15:02,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:rsgroup,,1689704100037.f93adf710ff4a74dd94f702a94eae3b9. 2023-07-18 18:15:02,139 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8ab57ef3c304060a36aefb04d3f2016 2023-07-18 18:15:02,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/namespace/d23c1442c2c7f56c495c93a095f3c4eb/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2023-07-18 18:15:02,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:15:02,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d23c1442c2c7f56c495c93a095f3c4eb: 2023-07-18 18:15:02,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689704099869.d23c1442c2c7f56c495c93a095f3c4eb. 2023-07-18 18:15:02,158 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:02,158 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:42293-0x10179a4edb40003, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:02,158 INFO [RS:2;jenkins-hbase4:42293] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42293,1689704099021; zookeeper connection closed. 2023-07-18 18:15:02,160 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76e1d043] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76e1d043 2023-07-18 18:15:02,165 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=562 B at sequenceid=31 (bloomFilter=false), to=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/.tmp/table/babe5e6bd1b54dddb857702748fa629f 2023-07-18 18:15:02,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for babe5e6bd1b54dddb857702748fa629f 2023-07-18 18:15:02,174 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/.tmp/info/0b79a5f47b804067862365d71626d21e as hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/info/0b79a5f47b804067862365d71626d21e 2023-07-18 18:15:02,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b79a5f47b804067862365d71626d21e 2023-07-18 18:15:02,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/info/0b79a5f47b804067862365d71626d21e, entries=32, sequenceid=31, filesize=8.5 K 2023-07-18 18:15:02,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/.tmp/rep_barrier/c8ab57ef3c304060a36aefb04d3f2016 as hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/rep_barrier/c8ab57ef3c304060a36aefb04d3f2016 2023-07-18 18:15:02,201 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34463,1689704098701; all regions closed. 2023-07-18 18:15:02,201 DEBUG [RS:0;jenkins-hbase4:34463] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-18 18:15:02,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8ab57ef3c304060a36aefb04d3f2016 2023-07-18 18:15:02,205 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/rep_barrier/c8ab57ef3c304060a36aefb04d3f2016, entries=1, sequenceid=31, filesize=4.9 K 2023-07-18 18:15:02,207 DEBUG [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 18:15:02,210 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,34463,1689704098701/jenkins-hbase4.apache.org%2C34463%2C1689704098701.1689704099712 not finished, retry = 0 2023-07-18 18:15:02,211 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/.tmp/table/babe5e6bd1b54dddb857702748fa629f as hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/table/babe5e6bd1b54dddb857702748fa629f 2023-07-18 18:15:02,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for babe5e6bd1b54dddb857702748fa629f 2023-07-18 18:15:02,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/table/babe5e6bd1b54dddb857702748fa629f, entries=8, sequenceid=31, filesize=5.2 K 2023-07-18 18:15:02,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~5.89 KB/6036, heapSize ~11.05 KB/11312, currentSize=0 B/0 for 1588230740 in 210ms, sequenceid=31, compaction requested=false 2023-07-18 18:15:02,218 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 18:15:02,229 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/data/hbase/meta/1588230740/recovered.edits/34.seqid, newMaxSeqId=34, maxSeqId=1 2023-07-18 18:15:02,229 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:15:02,230 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:15:02,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:15:02,230 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 18:15:02,313 DEBUG [RS:0;jenkins-hbase4:34463] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/oldWALs 2023-07-18 18:15:02,313 INFO [RS:0;jenkins-hbase4:34463] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34463%2C1689704098701:(num 1689704099712) 2023-07-18 18:15:02,313 DEBUG [RS:0;jenkins-hbase4:34463] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:02,313 INFO [RS:0;jenkins-hbase4:34463] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:02,314 INFO [RS:0;jenkins-hbase4:34463] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:15:02,314 INFO [RS:0;jenkins-hbase4:34463] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:15:02,314 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:02,314 INFO [RS:0;jenkins-hbase4:34463] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:15:02,314 INFO [RS:0;jenkins-hbase4:34463] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:15:02,315 INFO [RS:0;jenkins-hbase4:34463] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34463 2023-07-18 18:15:02,318 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:15:02,318 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:02,318 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34463,1689704098701 2023-07-18 18:15:02,320 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34463,1689704098701] 2023-07-18 18:15:02,320 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34463,1689704098701; numProcessing=2 2023-07-18 18:15:02,321 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34463,1689704098701 already deleted, retry=false 2023-07-18 18:15:02,321 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34463,1689704098701 expired; onlineServers=1 2023-07-18 18:15:02,407 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36449,1689704098858; all regions closed. 2023-07-18 18:15:02,408 DEBUG [RS:1;jenkins-hbase4:36449] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2023-07-18 18:15:02,413 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/WALs/jenkins-hbase4.apache.org,36449,1689704098858/jenkins-hbase4.apache.org%2C36449%2C1689704098858.meta.1689704099815.meta not finished, retry = 0 2023-07-18 18:15:02,516 DEBUG [RS:1;jenkins-hbase4:36449] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/oldWALs 2023-07-18 18:15:02,516 INFO [RS:1;jenkins-hbase4:36449] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36449%2C1689704098858.meta:.meta(num 1689704099815) 2023-07-18 18:15:02,521 DEBUG [RS:1;jenkins-hbase4:36449] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/oldWALs 2023-07-18 18:15:02,521 INFO [RS:1;jenkins-hbase4:36449] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36449%2C1689704098858:(num 1689704099735) 2023-07-18 18:15:02,521 DEBUG [RS:1;jenkins-hbase4:36449] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:02,521 INFO [RS:1;jenkins-hbase4:36449] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:02,521 INFO [RS:1;jenkins-hbase4:36449] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:15:02,521 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:02,522 INFO [RS:1;jenkins-hbase4:36449] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36449 2023-07-18 18:15:02,526 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36449,1689704098858 2023-07-18 18:15:02,526 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:02,527 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36449,1689704098858] 2023-07-18 18:15:02,527 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36449,1689704098858; numProcessing=3 2023-07-18 18:15:02,529 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36449,1689704098858 already deleted, retry=false 2023-07-18 18:15:02,529 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36449,1689704098858 expired; onlineServers=0 2023-07-18 18:15:02,529 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38247,1689704098505' ***** 2023-07-18 18:15:02,529 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 18:15:02,531 DEBUG [M:0;jenkins-hbase4:38247] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bc1db32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:15:02,531 INFO [M:0;jenkins-hbase4:38247] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:02,533 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 18:15:02,533 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:02,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:15:02,533 INFO [M:0;jenkins-hbase4:38247] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@3362b59a{master,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-18 18:15:02,534 INFO [M:0;jenkins-hbase4:38247] server.AbstractConnector(383): Stopped ServerConnector@326eddd2{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:02,534 INFO [M:0;jenkins-hbase4:38247] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:02,534 INFO [M:0;jenkins-hbase4:38247] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@625ee407{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:02,534 INFO [M:0;jenkins-hbase4:38247] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@44a9cf4{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:02,534 INFO [M:0;jenkins-hbase4:38247] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38247,1689704098505 2023-07-18 18:15:02,534 INFO [M:0;jenkins-hbase4:38247] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38247,1689704098505; all regions closed. 2023-07-18 18:15:02,534 DEBUG [M:0;jenkins-hbase4:38247] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:02,534 INFO [M:0;jenkins-hbase4:38247] master.HMaster(1491): Stopping master jetty server 2023-07-18 18:15:02,535 INFO [M:0;jenkins-hbase4:38247] server.AbstractConnector(383): Stopped ServerConnector@2e22b53c{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:02,536 DEBUG [M:0;jenkins-hbase4:38247] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 18:15:02,536 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 18:15:02,536 DEBUG [M:0;jenkins-hbase4:38247] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 18:15:02,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704099445] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704099445,5,FailOnTimeoutGroup] 2023-07-18 18:15:02,536 INFO [M:0;jenkins-hbase4:38247] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 18:15:02,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704099444] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704099444,5,FailOnTimeoutGroup] 2023-07-18 18:15:02,537 INFO [M:0;jenkins-hbase4:38247] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 18:15:02,537 INFO [M:0;jenkins-hbase4:38247] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:15:02,537 DEBUG [M:0;jenkins-hbase4:38247] master.HMaster(1512): Stopping service threads 2023-07-18 18:15:02,538 INFO [M:0;jenkins-hbase4:38247] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 18:15:02,538 ERROR [M:0;jenkins-hbase4:38247] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-18 18:15:02,538 INFO [M:0;jenkins-hbase4:38247] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 18:15:02,538 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 18:15:02,539 DEBUG [M:0;jenkins-hbase4:38247] zookeeper.ZKUtil(398): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 18:15:02,539 WARN [M:0;jenkins-hbase4:38247] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 18:15:02,539 INFO [M:0;jenkins-hbase4:38247] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 18:15:02,539 INFO [M:0;jenkins-hbase4:38247] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 18:15:02,539 DEBUG [M:0;jenkins-hbase4:38247] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:15:02,539 INFO [M:0;jenkins-hbase4:38247] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:02,539 DEBUG [M:0;jenkins-hbase4:38247] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:02,539 DEBUG [M:0;jenkins-hbase4:38247] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:15:02,539 DEBUG [M:0;jenkins-hbase4:38247] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:02,540 INFO [M:0;jenkins-hbase4:38247] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=92.97 KB heapSize=109.13 KB 2023-07-18 18:15:02,555 INFO [M:0;jenkins-hbase4:38247] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=92.97 KB at sequenceid=194 (bloomFilter=true), to=hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/281d8af7167742378128b49343f7c9ec 2023-07-18 18:15:02,561 DEBUG [M:0;jenkins-hbase4:38247] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/281d8af7167742378128b49343f7c9ec as hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/281d8af7167742378128b49343f7c9ec 2023-07-18 18:15:02,567 INFO [M:0;jenkins-hbase4:38247] regionserver.HStore(1080): Added hdfs://localhost:34101/user/jenkins/test-data/8c862379-d29b-c119-b43e-0ee303fcc320/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/281d8af7167742378128b49343f7c9ec, entries=24, sequenceid=194, filesize=12.4 K 2023-07-18 18:15:02,569 INFO [M:0;jenkins-hbase4:38247] regionserver.HRegion(2948): Finished flush of dataSize ~92.97 KB/95197, heapSize ~109.11 KB/111728, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=194, compaction requested=false 2023-07-18 18:15:02,574 INFO [M:0;jenkins-hbase4:38247] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:02,575 DEBUG [M:0;jenkins-hbase4:38247] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:15:02,580 INFO [M:0;jenkins-hbase4:38247] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 18:15:02,580 INFO [M:0;jenkins-hbase4:38247] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38247 2023-07-18 18:15:02,581 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:02,582 DEBUG [M:0;jenkins-hbase4:38247] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38247,1689704098505 already deleted, retry=false 2023-07-18 18:15:02,659 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:02,659 INFO [RS:1;jenkins-hbase4:36449] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36449,1689704098858; zookeeper connection closed. 2023-07-18 18:15:02,659 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:36449-0x10179a4edb40002, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:02,661 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@70ff60fc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@70ff60fc 2023-07-18 18:15:02,759 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:02,759 INFO [RS:0;jenkins-hbase4:34463] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34463,1689704098701; zookeeper connection closed. 2023-07-18 18:15:02,759 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): regionserver:34463-0x10179a4edb40001, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:02,759 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@748af768] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@748af768 2023-07-18 18:15:02,760 INFO [Listener at localhost/33663] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-18 18:15:02,859 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:02,859 INFO [M:0;jenkins-hbase4:38247] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38247,1689704098505; zookeeper connection closed. 2023-07-18 18:15:02,859 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): master:38247-0x10179a4edb40000, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:02,860 WARN [Listener at localhost/33663] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:15:02,864 INFO [Listener at localhost/33663] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:15:02,969 WARN [BP-1261226517-172.31.14.131-1689704097559 heartbeating to localhost/127.0.0.1:34101] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:15:02,969 WARN [BP-1261226517-172.31.14.131-1689704097559 heartbeating to localhost/127.0.0.1:34101] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1261226517-172.31.14.131-1689704097559 (Datanode Uuid 486e18f6-21f2-42dd-9bd0-45d5de8dfc72) service to localhost/127.0.0.1:34101 2023-07-18 18:15:02,970 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/dfs/data/data5/current/BP-1261226517-172.31.14.131-1689704097559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:02,971 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/dfs/data/data6/current/BP-1261226517-172.31.14.131-1689704097559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:02,972 WARN [Listener at localhost/33663] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:15:02,980 INFO [Listener at localhost/33663] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:15:03,084 WARN [BP-1261226517-172.31.14.131-1689704097559 heartbeating to localhost/127.0.0.1:34101] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:15:03,084 WARN [BP-1261226517-172.31.14.131-1689704097559 heartbeating to localhost/127.0.0.1:34101] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1261226517-172.31.14.131-1689704097559 (Datanode Uuid 375062e7-29a0-485d-87d6-90e44a21364a) service to localhost/127.0.0.1:34101 2023-07-18 18:15:03,085 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/dfs/data/data3/current/BP-1261226517-172.31.14.131-1689704097559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:03,085 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/dfs/data/data4/current/BP-1261226517-172.31.14.131-1689704097559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:03,086 WARN [Listener at localhost/33663] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:15:03,090 INFO [Listener at localhost/33663] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:15:03,194 WARN [BP-1261226517-172.31.14.131-1689704097559 heartbeating to localhost/127.0.0.1:34101] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:15:03,194 WARN [BP-1261226517-172.31.14.131-1689704097559 heartbeating to localhost/127.0.0.1:34101] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1261226517-172.31.14.131-1689704097559 (Datanode Uuid f6fbe9a7-c1c9-4c40-bd33-eca9f837a293) service to localhost/127.0.0.1:34101 2023-07-18 18:15:03,195 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/dfs/data/data1/current/BP-1261226517-172.31.14.131-1689704097559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:03,195 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/cluster_7791ea07-4fd2-e153-977f-9d0681f8a887/dfs/data/data2/current/BP-1261226517-172.31.14.131-1689704097559] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:03,205 INFO [Listener at localhost/33663] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:15:03,321 INFO [Listener at localhost/33663] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.log.dir so I do NOT create it in target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2e4dee95-b72d-7c56-7af2-6f64380df2a5/hadoop.tmp.dir so I do NOT create it in target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a, deleteOnExit=true 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/test.cache.data in system properties and HBase conf 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 18:15:03,348 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir in system properties and HBase conf 2023-07-18 18:15:03,349 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 18:15:03,349 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 18:15:03,349 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 18:15:03,349 DEBUG [Listener at localhost/33663] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 18:15:03,349 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:15:03,349 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:15:03,349 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 18:15:03,349 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:15:03,349 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/nfs.dump.dir in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 18:15:03,350 INFO [Listener at localhost/33663] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 18:15:03,354 WARN [Listener at localhost/33663] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:15:03,354 WARN [Listener at localhost/33663] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:15:03,396 WARN [Listener at localhost/33663] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:15:03,398 INFO [Listener at localhost/33663] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:15:03,403 INFO [Listener at localhost/33663] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/Jetty_localhost_33473_hdfs____.xfc6g6/webapp 2023-07-18 18:15:03,419 DEBUG [Listener at localhost/33663-EventThread] zookeeper.ZKWatcher(600): VerifyingRSGroupAdminClient-0x10179a4edb4000a, quorum=127.0.0.1:58836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Disconnected, path=null 2023-07-18 18:15:03,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(630): VerifyingRSGroupAdminClient-0x10179a4edb4000a, quorum=127.0.0.1:58836, baseZNode=/hbase Received Disconnected from ZooKeeper, ignoring 2023-07-18 18:15:03,496 INFO [Listener at localhost/33663] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33473 2023-07-18 18:15:03,500 WARN [Listener at localhost/33663] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:15:03,500 WARN [Listener at localhost/33663] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:15:03,543 WARN [Listener at localhost/32911] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:15:03,553 WARN [Listener at localhost/32911] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:15:03,555 WARN [Listener at localhost/32911] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:15:03,556 INFO [Listener at localhost/32911] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:15:03,560 INFO [Listener at localhost/32911] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/Jetty_localhost_46213_datanode____.aknu2v/webapp 2023-07-18 18:15:03,652 INFO [Listener at localhost/32911] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46213 2023-07-18 18:15:03,659 WARN [Listener at localhost/37933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:15:03,672 WARN [Listener at localhost/37933] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:15:03,674 WARN [Listener at localhost/37933] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:15:03,674 INFO [Listener at localhost/37933] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:15:03,678 INFO [Listener at localhost/37933] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/Jetty_localhost_41681_datanode____bin4s9/webapp 2023-07-18 18:15:03,761 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x613f56c71688ab76: Processing first storage report for DS-97e48754-487f-43e7-9862-217070f57ef7 from datanode c1f2a1f8-db22-46a7-b73d-643ce82f03fb 2023-07-18 18:15:03,761 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x613f56c71688ab76: from storage DS-97e48754-487f-43e7-9862-217070f57ef7 node DatanodeRegistration(127.0.0.1:34925, datanodeUuid=c1f2a1f8-db22-46a7-b73d-643ce82f03fb, infoPort=44569, infoSecurePort=0, ipcPort=37933, storageInfo=lv=-57;cid=testClusterID;nsid=1086109228;c=1689704103357), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:15:03,761 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x613f56c71688ab76: Processing first storage report for DS-a8bbac2a-c1cf-4bc7-88c1-708508c7e572 from datanode c1f2a1f8-db22-46a7-b73d-643ce82f03fb 2023-07-18 18:15:03,761 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x613f56c71688ab76: from storage DS-a8bbac2a-c1cf-4bc7-88c1-708508c7e572 node DatanodeRegistration(127.0.0.1:34925, datanodeUuid=c1f2a1f8-db22-46a7-b73d-643ce82f03fb, infoPort=44569, infoSecurePort=0, ipcPort=37933, storageInfo=lv=-57;cid=testClusterID;nsid=1086109228;c=1689704103357), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:15:03,787 INFO [Listener at localhost/37933] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41681 2023-07-18 18:15:03,796 WARN [Listener at localhost/35477] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:15:03,810 WARN [Listener at localhost/35477] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:15:03,812 WARN [Listener at localhost/35477] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:15:03,813 INFO [Listener at localhost/35477] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:15:03,817 INFO [Listener at localhost/35477] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/Jetty_localhost_43355_datanode____.3gl04l/webapp 2023-07-18 18:15:03,904 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc08ec3a610ff3119: Processing first storage report for DS-ed4c20e1-798a-4849-a08b-af1750185191 from datanode 6b494d8e-b53b-48de-8789-4347bfa4a89e 2023-07-18 18:15:03,904 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc08ec3a610ff3119: from storage DS-ed4c20e1-798a-4849-a08b-af1750185191 node DatanodeRegistration(127.0.0.1:37305, datanodeUuid=6b494d8e-b53b-48de-8789-4347bfa4a89e, infoPort=39753, infoSecurePort=0, ipcPort=35477, storageInfo=lv=-57;cid=testClusterID;nsid=1086109228;c=1689704103357), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:15:03,904 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc08ec3a610ff3119: Processing first storage report for DS-f1646ec5-aacd-47a0-bdae-1c7a069c9746 from datanode 6b494d8e-b53b-48de-8789-4347bfa4a89e 2023-07-18 18:15:03,904 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc08ec3a610ff3119: from storage DS-f1646ec5-aacd-47a0-bdae-1c7a069c9746 node DatanodeRegistration(127.0.0.1:37305, datanodeUuid=6b494d8e-b53b-48de-8789-4347bfa4a89e, infoPort=39753, infoSecurePort=0, ipcPort=35477, storageInfo=lv=-57;cid=testClusterID;nsid=1086109228;c=1689704103357), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:15:03,982 INFO [Listener at localhost/35477] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43355 2023-07-18 18:15:04,021 WARN [Listener at localhost/41213] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:15:04,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x49f490a5f41db167: Processing first storage report for DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5 from datanode 61bad10a-1a52-4568-8703-783fc478e307 2023-07-18 18:15:04,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x49f490a5f41db167: from storage DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5 node DatanodeRegistration(127.0.0.1:40845, datanodeUuid=61bad10a-1a52-4568-8703-783fc478e307, infoPort=41569, infoSecurePort=0, ipcPort=41213, storageInfo=lv=-57;cid=testClusterID;nsid=1086109228;c=1689704103357), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:15:04,130 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x49f490a5f41db167: Processing first storage report for DS-5be08ec1-7166-4a01-b9be-9165402c85cb from datanode 61bad10a-1a52-4568-8703-783fc478e307 2023-07-18 18:15:04,130 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x49f490a5f41db167: from storage DS-5be08ec1-7166-4a01-b9be-9165402c85cb node DatanodeRegistration(127.0.0.1:40845, datanodeUuid=61bad10a-1a52-4568-8703-783fc478e307, infoPort=41569, infoSecurePort=0, ipcPort=41213, storageInfo=lv=-57;cid=testClusterID;nsid=1086109228;c=1689704103357), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:15:04,131 DEBUG [Listener at localhost/41213] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159 2023-07-18 18:15:04,133 INFO [Listener at localhost/41213] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/zookeeper_0, clientPort=57697, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 18:15:04,134 INFO [Listener at localhost/41213] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57697 2023-07-18 18:15:04,134 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,135 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,149 INFO [Listener at localhost/41213] util.FSUtils(471): Created version file at hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a with version=8 2023-07-18 18:15:04,149 INFO [Listener at localhost/41213] hbase.HBaseTestingUtility(1408): The hbase.fs.tmp.dir is set to hdfs://localhost:46377/user/jenkins/test-data/ec3d2837-ee7c-6dde-2a59-7dc4d5787e9c/hbase-staging 2023-07-18 18:15:04,150 DEBUG [Listener at localhost/41213] hbase.LocalHBaseCluster(134): Setting Master Port to random. 2023-07-18 18:15:04,150 DEBUG [Listener at localhost/41213] hbase.LocalHBaseCluster(141): Setting RegionServer Port to random. 2023-07-18 18:15:04,150 DEBUG [Listener at localhost/41213] hbase.LocalHBaseCluster(151): Setting RS InfoServer Port to random. 2023-07-18 18:15:04,150 DEBUG [Listener at localhost/41213] hbase.LocalHBaseCluster(159): Setting Master InfoServer Port to random. 2023-07-18 18:15:04,151 INFO [Listener at localhost/41213] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:15:04,151 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,151 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,151 INFO [Listener at localhost/41213] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:15:04,151 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,151 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:15:04,152 INFO [Listener at localhost/41213] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:15:04,153 INFO [Listener at localhost/41213] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44147 2023-07-18 18:15:04,153 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,154 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,155 INFO [Listener at localhost/41213] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44147 connecting to ZooKeeper ensemble=127.0.0.1:57697 2023-07-18 18:15:04,163 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:441470x0, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:15:04,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44147-0x10179a503c80000 connected 2023-07-18 18:15:04,181 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:15:04,182 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:04,182 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:15:04,183 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44147 2023-07-18 18:15:04,184 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44147 2023-07-18 18:15:04,185 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44147 2023-07-18 18:15:04,185 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44147 2023-07-18 18:15:04,185 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44147 2023-07-18 18:15:04,187 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:15:04,187 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:15:04,187 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:15:04,187 INFO [Listener at localhost/41213] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context master 2023-07-18 18:15:04,188 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:15:04,188 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:15:04,188 INFO [Listener at localhost/41213] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:15:04,188 INFO [Listener at localhost/41213] http.HttpServer(1146): Jetty bound to port 33611 2023-07-18 18:15:04,188 INFO [Listener at localhost/41213] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:15:04,190 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,190 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@558dcba1{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:15:04,190 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,190 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2ce8454f{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:15:04,305 INFO [Listener at localhost/41213] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:15:04,307 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:15:04,307 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:15:04,307 INFO [Listener at localhost/41213] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:15:04,309 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,310 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@21d993e9{master,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/jetty-0_0_0_0-33611-hbase-server-2_4_18-SNAPSHOT_jar-_-any-6138509765267998760/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-18 18:15:04,311 INFO [Listener at localhost/41213] server.AbstractConnector(333): Started ServerConnector@50e3498a{HTTP/1.1, (http/1.1)}{0.0.0.0:33611} 2023-07-18 18:15:04,312 INFO [Listener at localhost/41213] server.Server(415): Started @42588ms 2023-07-18 18:15:04,312 INFO [Listener at localhost/41213] master.HMaster(444): hbase.rootdir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a, hbase.cluster.distributed=false 2023-07-18 18:15:04,324 INFO [Listener at localhost/41213] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:15:04,324 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,324 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,325 INFO [Listener at localhost/41213] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:15:04,325 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,325 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:15:04,325 INFO [Listener at localhost/41213] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:15:04,325 INFO [Listener at localhost/41213] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35809 2023-07-18 18:15:04,326 INFO [Listener at localhost/41213] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:15:04,327 DEBUG [Listener at localhost/41213] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:15:04,327 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,328 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,329 INFO [Listener at localhost/41213] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35809 connecting to ZooKeeper ensemble=127.0.0.1:57697 2023-07-18 18:15:04,333 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:358090x0, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:15:04,335 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:358090x0, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:15:04,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35809-0x10179a503c80001 connected 2023-07-18 18:15:04,335 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:04,336 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:15:04,336 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35809 2023-07-18 18:15:04,336 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35809 2023-07-18 18:15:04,337 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35809 2023-07-18 18:15:04,337 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35809 2023-07-18 18:15:04,338 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35809 2023-07-18 18:15:04,339 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:15:04,339 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:15:04,339 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:15:04,340 INFO [Listener at localhost/41213] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:15:04,340 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:15:04,340 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:15:04,340 INFO [Listener at localhost/41213] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:15:04,341 INFO [Listener at localhost/41213] http.HttpServer(1146): Jetty bound to port 42835 2023-07-18 18:15:04,341 INFO [Listener at localhost/41213] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:15:04,343 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,343 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@75e5d650{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:15:04,344 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,344 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@295166fc{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:15:04,460 INFO [Listener at localhost/41213] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:15:04,461 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:15:04,461 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:15:04,462 INFO [Listener at localhost/41213] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:15:04,462 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,463 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@5d16009b{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/jetty-0_0_0_0-42835-hbase-server-2_4_18-SNAPSHOT_jar-_-any-8596664714184182641/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:04,464 INFO [Listener at localhost/41213] server.AbstractConnector(333): Started ServerConnector@6ba4dce4{HTTP/1.1, (http/1.1)}{0.0.0.0:42835} 2023-07-18 18:15:04,464 INFO [Listener at localhost/41213] server.Server(415): Started @42741ms 2023-07-18 18:15:04,476 INFO [Listener at localhost/41213] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:15:04,476 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,476 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,476 INFO [Listener at localhost/41213] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:15:04,477 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,477 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:15:04,477 INFO [Listener at localhost/41213] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:15:04,477 INFO [Listener at localhost/41213] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46305 2023-07-18 18:15:04,478 INFO [Listener at localhost/41213] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:15:04,479 DEBUG [Listener at localhost/41213] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:15:04,479 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,480 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,481 INFO [Listener at localhost/41213] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46305 connecting to ZooKeeper ensemble=127.0.0.1:57697 2023-07-18 18:15:04,485 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:463050x0, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:15:04,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46305-0x10179a503c80002 connected 2023-07-18 18:15:04,486 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:15:04,487 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:04,487 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:15:04,488 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46305 2023-07-18 18:15:04,488 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46305 2023-07-18 18:15:04,488 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46305 2023-07-18 18:15:04,488 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46305 2023-07-18 18:15:04,489 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46305 2023-07-18 18:15:04,490 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:15:04,490 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:15:04,490 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:15:04,491 INFO [Listener at localhost/41213] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:15:04,491 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:15:04,491 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:15:04,491 INFO [Listener at localhost/41213] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:15:04,492 INFO [Listener at localhost/41213] http.HttpServer(1146): Jetty bound to port 44737 2023-07-18 18:15:04,492 INFO [Listener at localhost/41213] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:15:04,493 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,493 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@288689f8{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:15:04,493 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,494 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@42cd0009{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:15:04,606 INFO [Listener at localhost/41213] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:15:04,606 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:15:04,607 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:15:04,607 INFO [Listener at localhost/41213] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:15:04,607 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,608 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@1f4b851f{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/jetty-0_0_0_0-44737-hbase-server-2_4_18-SNAPSHOT_jar-_-any-7488906112133242290/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:04,611 INFO [Listener at localhost/41213] server.AbstractConnector(333): Started ServerConnector@6d04da20{HTTP/1.1, (http/1.1)}{0.0.0.0:44737} 2023-07-18 18:15:04,612 INFO [Listener at localhost/41213] server.Server(415): Started @42888ms 2023-07-18 18:15:04,623 INFO [Listener at localhost/41213] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:15:04,623 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,623 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,623 INFO [Listener at localhost/41213] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:15:04,623 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:04,623 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:15:04,623 INFO [Listener at localhost/41213] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:15:04,624 INFO [Listener at localhost/41213] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40393 2023-07-18 18:15:04,625 INFO [Listener at localhost/41213] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:15:04,626 DEBUG [Listener at localhost/41213] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:15:04,627 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,627 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,628 INFO [Listener at localhost/41213] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40393 connecting to ZooKeeper ensemble=127.0.0.1:57697 2023-07-18 18:15:04,632 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:403930x0, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:15:04,634 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:403930x0, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:15:04,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40393-0x10179a503c80003 connected 2023-07-18 18:15:04,635 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:04,635 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:15:04,636 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40393 2023-07-18 18:15:04,636 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40393 2023-07-18 18:15:04,638 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40393 2023-07-18 18:15:04,638 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40393 2023-07-18 18:15:04,639 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40393 2023-07-18 18:15:04,640 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:15:04,641 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:15:04,641 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:15:04,641 INFO [Listener at localhost/41213] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:15:04,641 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:15:04,641 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:15:04,641 INFO [Listener at localhost/41213] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:15:04,642 INFO [Listener at localhost/41213] http.HttpServer(1146): Jetty bound to port 32879 2023-07-18 18:15:04,642 INFO [Listener at localhost/41213] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:15:04,643 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,643 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@51b99b82{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:15:04,644 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,644 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@736db136{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:15:04,760 INFO [Listener at localhost/41213] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:15:04,760 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:15:04,761 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:15:04,761 INFO [Listener at localhost/41213] session.HouseKeeper(132): node0 Scavenging every 600000ms 2023-07-18 18:15:04,762 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:04,762 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@72c3dca2{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/jetty-0_0_0_0-32879-hbase-server-2_4_18-SNAPSHOT_jar-_-any-1674371386102186396/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:04,764 INFO [Listener at localhost/41213] server.AbstractConnector(333): Started ServerConnector@72f6fde0{HTTP/1.1, (http/1.1)}{0.0.0.0:32879} 2023-07-18 18:15:04,764 INFO [Listener at localhost/41213] server.Server(415): Started @43040ms 2023-07-18 18:15:04,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:15:04,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.AbstractConnector(333): Started ServerConnector@780ec191{HTTP/1.1, (http/1.1)}{0.0.0.0:45539} 2023-07-18 18:15:04,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] server.Server(415): Started @43046ms 2023-07-18 18:15:04,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:04,771 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:15:04,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:04,773 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:15:04,773 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:15:04,774 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:15:04,774 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:15:04,774 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:04,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:15:04,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:15:04,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44147,1689704104150 from backup master directory 2023-07-18 18:15:04,779 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:04,779 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:15:04,779 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:15:04,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:04,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/hbase.id with ID: a130cbca-bf8e-41ac-a28c-83fea467f6eb 2023-07-18 18:15:04,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:04,833 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:04,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x29eac85c to 127.0.0.1:57697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:04,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cc879db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:04,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:04,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 18:15:04,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:15:04,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store-tmp 2023-07-18 18:15:04,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:04,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:15:04,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:04,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:04,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:15:04,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:04,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:04,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:15:04,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/WALs/jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:04,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44147%2C1689704104150, suffix=, logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/WALs/jenkins-hbase4.apache.org,44147,1689704104150, archiveDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/oldWALs, maxLogs=10 2023-07-18 18:15:04,896 DEBUG [RS-EventLoopGroup-15-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK] 2023-07-18 18:15:04,899 DEBUG [RS-EventLoopGroup-15-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK] 2023-07-18 18:15:04,899 DEBUG [RS-EventLoopGroup-15-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK] 2023-07-18 18:15:04,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/WALs/jenkins-hbase4.apache.org,44147,1689704104150/jenkins-hbase4.apache.org%2C44147%2C1689704104150.1689704104877 2023-07-18 18:15:04,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK], DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK], DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK]] 2023-07-18 18:15:04,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:04,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:04,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:15:04,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:15:04,904 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:15:04,905 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 18:15:04,906 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 18:15:04,906 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:04,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:15:04,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:15:04,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:15:04,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:04,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10573394080, jitterRate=-0.015275940299034119}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:15:04,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:15:04,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 18:15:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 18:15:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 18:15:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 18:15:04,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-18 18:15:04,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-07-18 18:15:04,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 18:15:04,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 18:15:04,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 18:15:04,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 18:15:04,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 18:15:04,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 18:15:04,923 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:04,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 18:15:04,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 18:15:04,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 18:15:04,926 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:04,926 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:04,926 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:04,926 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:04,926 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:04,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44147,1689704104150, sessionid=0x10179a503c80000, setting cluster-up flag (Was=false) 2023-07-18 18:15:04,933 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:04,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 18:15:04,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:04,942 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:04,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 18:15:04,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:04,948 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.hbase-snapshot/.tmp 2023-07-18 18:15:04,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=RSGroupAdminService 2023-07-18 18:15:04,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] rsgroup.RSGroupInfoManagerImpl(537): Refreshing in Offline mode. 2023-07-18 18:15:04,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint loaded, priority=536870911. 2023-07-18 18:15:04,950 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:15:04,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver loaded, priority=536870912. 2023-07-18 18:15:04,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 18:15:04,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 18:15:04,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 18:15:04,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 18:15:04,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 18:15:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:15:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:15:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:15:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:15:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 18:15:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:15:04,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:04,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689704134969 2023-07-18 18:15:04,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 18:15:04,970 INFO [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(951): ClusterId : a130cbca-bf8e-41ac-a28c-83fea467f6eb 2023-07-18 18:15:04,970 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(951): ClusterId : a130cbca-bf8e-41ac-a28c-83fea467f6eb 2023-07-18 18:15:04,970 DEBUG [RS:1;jenkins-hbase4:46305] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:15:04,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 18:15:04,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 18:15:04,970 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:15:04,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 18:15:04,971 INFO [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(951): ClusterId : a130cbca-bf8e-41ac-a28c-83fea467f6eb 2023-07-18 18:15:04,971 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:15:04,971 DEBUG [RS:2;jenkins-hbase4:40393] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:15:04,971 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 18:15:04,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 18:15:04,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 18:15:04,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:04,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 18:15:04,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 18:15:04,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 18:15:04,973 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:04,974 DEBUG [RS:1;jenkins-hbase4:46305] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:15:04,974 DEBUG [RS:1;jenkins-hbase4:46305] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:15:04,974 DEBUG [RS:2;jenkins-hbase4:40393] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:15:04,974 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:15:04,974 DEBUG [RS:2;jenkins-hbase4:40393] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:15:04,974 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:15:04,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 18:15:04,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 18:15:04,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704104975,5,FailOnTimeoutGroup] 2023-07-18 18:15:04,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704104975,5,FailOnTimeoutGroup] 2023-07-18 18:15:04,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:04,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 18:15:04,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:04,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:04,977 DEBUG [RS:1;jenkins-hbase4:46305] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:15:04,979 DEBUG [RS:2;jenkins-hbase4:40393] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:15:04,980 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:15:04,982 DEBUG [RS:1;jenkins-hbase4:46305] zookeeper.ReadOnlyZKClient(139): Connect 0x77bee678 to 127.0.0.1:57697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:04,987 DEBUG [RS:2;jenkins-hbase4:40393] zookeeper.ReadOnlyZKClient(139): Connect 0x049601de to 127.0.0.1:57697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:04,987 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ReadOnlyZKClient(139): Connect 0x3b126027 to 127.0.0.1:57697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:05,007 DEBUG [RS:1;jenkins-hbase4:46305] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@797916ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:05,007 DEBUG [RS:0;jenkins-hbase4:35809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b1ddab6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:05,007 DEBUG [RS:1;jenkins-hbase4:46305] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d468d08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:15:05,007 DEBUG [RS:2;jenkins-hbase4:40393] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2831a688, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:05,008 DEBUG [RS:0;jenkins-hbase4:35809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a633e43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:15:05,008 DEBUG [RS:2;jenkins-hbase4:40393] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35586448, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:15:05,018 DEBUG [RS:1;jenkins-hbase4:46305] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46305 2023-07-18 18:15:05,018 INFO [RS:1;jenkins-hbase4:46305] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:15:05,018 INFO [RS:1;jenkins-hbase4:46305] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:15:05,018 DEBUG [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:15:05,018 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35809 2023-07-18 18:15:05,019 INFO [RS:0;jenkins-hbase4:35809] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:15:05,019 INFO [RS:0;jenkins-hbase4:35809] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:15:05,019 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:15:05,019 DEBUG [RS:2;jenkins-hbase4:40393] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40393 2023-07-18 18:15:05,019 INFO [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44147,1689704104150 with isa=jenkins-hbase4.apache.org/172.31.14.131:46305, startcode=1689704104476 2023-07-18 18:15:05,019 INFO [RS:2;jenkins-hbase4:40393] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:15:05,019 INFO [RS:2;jenkins-hbase4:40393] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:15:05,019 DEBUG [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:15:05,019 DEBUG [RS:1;jenkins-hbase4:46305] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:15:05,019 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44147,1689704104150 with isa=jenkins-hbase4.apache.org/172.31.14.131:35809, startcode=1689704104324 2023-07-18 18:15:05,019 DEBUG [RS:0;jenkins-hbase4:35809] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:15:05,019 INFO [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44147,1689704104150 with isa=jenkins-hbase4.apache.org/172.31.14.131:40393, startcode=1689704104623 2023-07-18 18:15:05,020 DEBUG [RS:2;jenkins-hbase4:40393] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:15:05,021 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39827, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:15:05,021 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45205, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:15:05,021 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44929, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:15:05,022 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:05,023 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:15:05,023 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 1 2023-07-18 18:15:05,023 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,024 DEBUG [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a 2023-07-18 18:15:05,024 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:15:05,024 DEBUG [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32911 2023-07-18 18:15:05,024 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 2 2023-07-18 18:15:05,024 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:05,024 DEBUG [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=33611 2023-07-18 18:15:05,024 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:15:05,024 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a 2023-07-18 18:15:05,024 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 3 2023-07-18 18:15:05,024 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32911 2023-07-18 18:15:05,024 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=33611 2023-07-18 18:15:05,024 DEBUG [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a 2023-07-18 18:15:05,024 DEBUG [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32911 2023-07-18 18:15:05,024 DEBUG [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=33611 2023-07-18 18:15:05,026 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:05,033 DEBUG [RS:1;jenkins-hbase4:46305] zookeeper.ZKUtil(162): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:05,034 WARN [RS:1;jenkins-hbase4:46305] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:15:05,034 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35809,1689704104324] 2023-07-18 18:15:05,034 INFO [RS:1;jenkins-hbase4:46305] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:15:05,034 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46305,1689704104476] 2023-07-18 18:15:05,034 DEBUG [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:05,034 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ZKUtil(162): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,034 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40393,1689704104623] 2023-07-18 18:15:05,034 DEBUG [RS:2;jenkins-hbase4:40393] zookeeper.ZKUtil(162): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:05,034 WARN [RS:0;jenkins-hbase4:35809] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:15:05,034 WARN [RS:2;jenkins-hbase4:40393] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:15:05,034 INFO [RS:0;jenkins-hbase4:35809] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:15:05,034 INFO [RS:2;jenkins-hbase4:40393] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:15:05,035 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,035 DEBUG [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:05,044 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ZKUtil(162): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:05,044 DEBUG [RS:2;jenkins-hbase4:40393] zookeeper.ZKUtil(162): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:05,044 DEBUG [RS:1;jenkins-hbase4:46305] zookeeper.ZKUtil(162): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:05,044 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ZKUtil(162): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,045 DEBUG [RS:2;jenkins-hbase4:40393] zookeeper.ZKUtil(162): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,045 DEBUG [RS:1;jenkins-hbase4:46305] zookeeper.ZKUtil(162): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,045 DEBUG [RS:2;jenkins-hbase4:40393] zookeeper.ZKUtil(162): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:05,045 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ZKUtil(162): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:05,045 DEBUG [RS:1;jenkins-hbase4:46305] zookeeper.ZKUtil(162): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:05,046 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:15:05,046 DEBUG [RS:2;jenkins-hbase4:40393] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:15:05,046 DEBUG [RS:1;jenkins-hbase4:46305] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:15:05,046 INFO [RS:0;jenkins-hbase4:35809] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:15:05,046 INFO [RS:2;jenkins-hbase4:40393] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:15:05,046 INFO [RS:1;jenkins-hbase4:46305] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:15:05,049 INFO [RS:0;jenkins-hbase4:35809] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:15:05,050 INFO [RS:1;jenkins-hbase4:46305] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:15:05,054 INFO [RS:2;jenkins-hbase4:40393] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:15:05,054 INFO [RS:0;jenkins-hbase4:35809] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:15:05,054 INFO [RS:1;jenkins-hbase4:46305] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:15:05,054 INFO [RS:2;jenkins-hbase4:40393] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:15:05,054 INFO [RS:1;jenkins-hbase4:46305] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,054 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,055 INFO [RS:2;jenkins-hbase4:40393] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,055 INFO [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:15:05,055 INFO [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:15:05,055 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:15:05,058 INFO [RS:1;jenkins-hbase4:46305] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,058 INFO [RS:2;jenkins-hbase4:40393] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,058 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,059 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,059 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,060 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:15:05,061 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:15:05,061 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:15:05,061 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:2;jenkins-hbase4:40393] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:0;jenkins-hbase4:35809] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,061 DEBUG [RS:1;jenkins-hbase4:46305] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:05,064 INFO [RS:2;jenkins-hbase4:40393] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,065 INFO [RS:2;jenkins-hbase4:40393] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,065 INFO [RS:2;jenkins-hbase4:40393] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,066 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,066 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,066 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,066 INFO [RS:1;jenkins-hbase4:46305] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,066 INFO [RS:1;jenkins-hbase4:46305] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,067 INFO [RS:1;jenkins-hbase4:46305] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,078 INFO [RS:2;jenkins-hbase4:40393] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:15:05,078 INFO [RS:2;jenkins-hbase4:40393] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40393,1689704104623-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,080 INFO [RS:0;jenkins-hbase4:35809] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:15:05,080 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35809,1689704104324-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,083 INFO [RS:1;jenkins-hbase4:46305] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:15:05,083 INFO [RS:1;jenkins-hbase4:46305] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46305,1689704104476-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,099 INFO [RS:2;jenkins-hbase4:40393] regionserver.Replication(203): jenkins-hbase4.apache.org,40393,1689704104623 started 2023-07-18 18:15:05,099 INFO [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40393,1689704104623, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40393, sessionid=0x10179a503c80003 2023-07-18 18:15:05,099 DEBUG [RS:2;jenkins-hbase4:40393] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:15:05,099 DEBUG [RS:2;jenkins-hbase4:40393] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:05,099 DEBUG [RS:2;jenkins-hbase4:40393] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40393,1689704104623' 2023-07-18 18:15:05,099 DEBUG [RS:2;jenkins-hbase4:40393] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:15:05,099 INFO [RS:0;jenkins-hbase4:35809] regionserver.Replication(203): jenkins-hbase4.apache.org,35809,1689704104324 started 2023-07-18 18:15:05,099 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35809,1689704104324, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35809, sessionid=0x10179a503c80001 2023-07-18 18:15:05,099 DEBUG [RS:2;jenkins-hbase4:40393] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:15:05,100 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:15:05,101 DEBUG [RS:0;jenkins-hbase4:35809] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,101 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35809,1689704104324' 2023-07-18 18:15:05,101 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:15:05,101 DEBUG [RS:2;jenkins-hbase4:40393] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:15:05,101 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:15:05,101 DEBUG [RS:2;jenkins-hbase4:40393] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:15:05,101 DEBUG [RS:2;jenkins-hbase4:40393] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:05,101 DEBUG [RS:2;jenkins-hbase4:40393] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40393,1689704104623' 2023-07-18 18:15:05,101 DEBUG [RS:2;jenkins-hbase4:40393] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:15:05,101 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:15:05,101 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:15:05,101 DEBUG [RS:0;jenkins-hbase4:35809] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,101 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35809,1689704104324' 2023-07-18 18:15:05,102 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:15:05,102 DEBUG [RS:2;jenkins-hbase4:40393] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:15:05,102 DEBUG [RS:0;jenkins-hbase4:35809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:15:05,102 DEBUG [RS:0;jenkins-hbase4:35809] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:15:05,102 INFO [RS:0;jenkins-hbase4:35809] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:15:05,102 INFO [RS:0;jenkins-hbase4:35809] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:15:05,102 DEBUG [RS:2;jenkins-hbase4:40393] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:15:05,102 INFO [RS:2;jenkins-hbase4:40393] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:15:05,103 INFO [RS:2;jenkins-hbase4:40393] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:15:05,104 INFO [RS:1;jenkins-hbase4:46305] regionserver.Replication(203): jenkins-hbase4.apache.org,46305,1689704104476 started 2023-07-18 18:15:05,104 INFO [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46305,1689704104476, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46305, sessionid=0x10179a503c80002 2023-07-18 18:15:05,104 DEBUG [RS:1;jenkins-hbase4:46305] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:15:05,104 DEBUG [RS:1;jenkins-hbase4:46305] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:05,105 DEBUG [RS:1;jenkins-hbase4:46305] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46305,1689704104476' 2023-07-18 18:15:05,105 DEBUG [RS:1;jenkins-hbase4:46305] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:15:05,105 DEBUG [RS:1;jenkins-hbase4:46305] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:15:05,105 DEBUG [RS:1;jenkins-hbase4:46305] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:15:05,105 DEBUG [RS:1;jenkins-hbase4:46305] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:15:05,106 DEBUG [RS:1;jenkins-hbase4:46305] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:05,106 DEBUG [RS:1;jenkins-hbase4:46305] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46305,1689704104476' 2023-07-18 18:15:05,106 DEBUG [RS:1;jenkins-hbase4:46305] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:15:05,106 DEBUG [RS:1;jenkins-hbase4:46305] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:15:05,106 DEBUG [RS:1;jenkins-hbase4:46305] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:15:05,106 INFO [RS:1;jenkins-hbase4:46305] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:15:05,106 INFO [RS:1;jenkins-hbase4:46305] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:15:05,204 INFO [RS:2;jenkins-hbase4:40393] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40393%2C1689704104623, suffix=, logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,40393,1689704104623, archiveDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs, maxLogs=32 2023-07-18 18:15:05,204 INFO [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35809%2C1689704104324, suffix=, logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,35809,1689704104324, archiveDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs, maxLogs=32 2023-07-18 18:15:05,208 INFO [RS:1;jenkins-hbase4:46305] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46305%2C1689704104476, suffix=, logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,46305,1689704104476, archiveDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs, maxLogs=32 2023-07-18 18:15:05,221 DEBUG [RS-EventLoopGroup-15-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK] 2023-07-18 18:15:05,221 DEBUG [RS-EventLoopGroup-15-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK] 2023-07-18 18:15:05,221 DEBUG [RS-EventLoopGroup-15-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK] 2023-07-18 18:15:05,230 DEBUG [RS-EventLoopGroup-15-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK] 2023-07-18 18:15:05,235 DEBUG [RS-EventLoopGroup-15-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK] 2023-07-18 18:15:05,237 DEBUG [RS-EventLoopGroup-15-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK] 2023-07-18 18:15:05,238 INFO [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,35809,1689704104324/jenkins-hbase4.apache.org%2C35809%2C1689704104324.1689704105205 2023-07-18 18:15:05,242 DEBUG [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK], DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK], DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK]] 2023-07-18 18:15:05,245 DEBUG [RS-EventLoopGroup-15-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK] 2023-07-18 18:15:05,245 DEBUG [RS-EventLoopGroup-15-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK] 2023-07-18 18:15:05,245 DEBUG [RS-EventLoopGroup-15-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK] 2023-07-18 18:15:05,246 INFO [RS:2;jenkins-hbase4:40393] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,40393,1689704104623/jenkins-hbase4.apache.org%2C40393%2C1689704104623.1689704105205 2023-07-18 18:15:05,250 DEBUG [RS:2;jenkins-hbase4:40393] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK], DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK], DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK]] 2023-07-18 18:15:05,251 INFO [RS:1;jenkins-hbase4:46305] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,46305,1689704104476/jenkins-hbase4.apache.org%2C46305%2C1689704104476.1689704105208 2023-07-18 18:15:05,251 DEBUG [RS:1;jenkins-hbase4:46305] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK], DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK], DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK]] 2023-07-18 18:15:05,335 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-07-18 18:15:05,417 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:15:05,418 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:15:05,418 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a 2023-07-18 18:15:05,431 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:05,432 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:15:05,434 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/info 2023-07-18 18:15:05,434 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:15:05,435 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:05,435 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:15:05,436 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:15:05,437 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:15:05,437 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:05,437 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:15:05,439 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/table 2023-07-18 18:15:05,439 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:15:05,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:05,440 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740 2023-07-18 18:15:05,441 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740 2023-07-18 18:15:05,443 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:15:05,444 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:15:05,446 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:05,446 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10961780480, jitterRate=0.02089536190032959}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:15:05,446 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:15:05,446 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:15:05,446 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:15:05,446 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:15:05,446 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:15:05,447 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:15:05,447 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:15:05,447 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:15:05,448 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:15:05,448 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 18:15:05,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 18:15:05,449 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 18:15:05,451 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 18:15:05,601 DEBUG [jenkins-hbase4:44147] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 18:15:05,601 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:15:05,602 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:15:05,602 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:15:05,602 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:15:05,602 DEBUG [jenkins-hbase4:44147] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:15:05,603 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35809,1689704104324, state=OPENING 2023-07-18 18:15:05,604 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 18:15:05,606 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:05,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35809,1689704104324}] 2023-07-18 18:15:05,606 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:15:05,760 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:05,760 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:15:05,762 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:15:05,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 18:15:05,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:15:05,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35809%2C1689704104324.meta, suffix=.meta, logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,35809,1689704104324, archiveDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs, maxLogs=32 2023-07-18 18:15:05,782 DEBUG [RS-EventLoopGroup-15-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK] 2023-07-18 18:15:05,783 DEBUG [RS-EventLoopGroup-15-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK] 2023-07-18 18:15:05,783 DEBUG [RS-EventLoopGroup-15-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK] 2023-07-18 18:15:05,785 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,35809,1689704104324/jenkins-hbase4.apache.org%2C35809%2C1689704104324.meta.1689704105767.meta 2023-07-18 18:15:05,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK], DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK], DatanodeInfoWithStorage[127.0.0.1:34925,DS-97e48754-487f-43e7-9862-217070f57ef7,DISK]] 2023-07-18 18:15:05,785 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:05,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:15:05,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 18:15:05,786 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 18:15:05,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 18:15:05,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:05,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 18:15:05,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 18:15:05,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:15:05,788 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/info 2023-07-18 18:15:05,788 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/info 2023-07-18 18:15:05,788 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:15:05,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:05,789 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:15:05,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:15:05,790 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:15:05,790 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:15:05,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:05,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:15:05,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/table 2023-07-18 18:15:05,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/table 2023-07-18 18:15:05,791 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:15:05,792 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:05,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740 2023-07-18 18:15:05,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740 2023-07-18 18:15:05,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:15:05,796 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:15:05,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=10038544320, jitterRate=-0.0650877058506012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:15:05,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:15:05,798 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689704105760 2023-07-18 18:15:05,804 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 18:15:05,804 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 18:15:05,805 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35809,1689704104324, state=OPEN 2023-07-18 18:15:05,807 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:15:05,807 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:15:05,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 18:15:05,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35809,1689704104324 in 201 msec 2023-07-18 18:15:05,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 18:15:05,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-07-18 18:15:05,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 860 msec 2023-07-18 18:15:05,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689704105811, completionTime=-1 2023-07-18 18:15:05,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 18:15:05,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 18:15:05,813 DEBUG [hconnection-0x6f4ce28c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:15:05,814 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:15:05,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 18:15:05,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689704165816 2023-07-18 18:15:05,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689704225816 2023-07-18 18:15:05,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-07-18 18:15:05,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1689704104150-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1689704104150-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1689704104150-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44147, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:05,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 18:15:05,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:05,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 18:15:05,823 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 18:15:05,824 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:15:05,824 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:15:05,826 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:05,826 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490 empty. 2023-07-18 18:15:05,827 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:05,827 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 18:15:05,838 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 18:15:05,839 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 93db80e00adf8c41f3e1975699c1a490, NAME => 'hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp 2023-07-18 18:15:05,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:05,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 93db80e00adf8c41f3e1975699c1a490, disabling compactions & flushes 2023-07-18 18:15:05,850 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:05,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:05,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. after waiting 0 ms 2023-07-18 18:15:05,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:05,850 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:05,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 93db80e00adf8c41f3e1975699c1a490: 2023-07-18 18:15:05,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:15:05,858 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704105858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704105858"}]},"ts":"1689704105858"} 2023-07-18 18:15:05,861 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:15:05,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:15:05,862 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704105862"}]},"ts":"1689704105862"} 2023-07-18 18:15:05,863 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 18:15:05,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:15:05,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:15:05,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:15:05,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:15:05,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:15:05,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=93db80e00adf8c41f3e1975699c1a490, ASSIGN}] 2023-07-18 18:15:05,870 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=93db80e00adf8c41f3e1975699c1a490, ASSIGN 2023-07-18 18:15:05,871 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=93db80e00adf8c41f3e1975699c1a490, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35809,1689704104324; forceNewPlan=false, retain=false 2023-07-18 18:15:06,022 INFO [jenkins-hbase4:44147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:15:06,023 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=93db80e00adf8c41f3e1975699c1a490, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:06,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704106023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704106023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704106023"}]},"ts":"1689704106023"} 2023-07-18 18:15:06,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 93db80e00adf8c41f3e1975699c1a490, server=jenkins-hbase4.apache.org,35809,1689704104324}] 2023-07-18 18:15:06,068 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,44147,1689704104150] master.HMaster(2148): Client=null/null create 'hbase:rsgroup', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|', METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'm', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:06,070 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,44147,1689704104150] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:rsgroup 2023-07-18 18:15:06,072 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=7, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:15:06,073 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=7, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:15:06,074 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,075 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177 empty. 2023-07-18 18:15:06,076 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,076 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:rsgroup regions 2023-07-18 18:15:06,089 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/hbase/rsgroup/.tabledesc/.tableinfo.0000000001 2023-07-18 18:15:06,090 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(7675): creating {ENCODED => 705cd38dcabb731d02b7bdaa205f3177, NAME => 'hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:rsgroup', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|', METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy'}}}, {NAME => 'm', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp 2023-07-18 18:15:06,100 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(866): Instantiated hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:06,100 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1604): Closing 705cd38dcabb731d02b7bdaa205f3177, disabling compactions & flushes 2023-07-18 18:15:06,100 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1626): Closing region hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:06,100 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:06,100 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. after waiting 0 ms 2023-07-18 18:15:06,100 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:06,100 INFO [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1838): Closed hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:06,100 DEBUG [RegionOpenAndInit-hbase:rsgroup-pool-0] regionserver.HRegion(1558): Region close journal for 705cd38dcabb731d02b7bdaa205f3177: 2023-07-18 18:15:06,102 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=7, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:15:06,103 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704106103"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704106103"}]},"ts":"1689704106103"} 2023-07-18 18:15:06,104 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:15:06,105 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=7, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:15:06,105 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:rsgroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704106105"}]},"ts":"1689704106105"} 2023-07-18 18:15:06,106 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:rsgroup, state=ENABLING in hbase:meta 2023-07-18 18:15:06,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:15:06,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:15:06,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:15:06,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:15:06,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:15:06,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=8, ppid=7, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:rsgroup, region=705cd38dcabb731d02b7bdaa205f3177, ASSIGN}] 2023-07-18 18:15:06,110 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=8, ppid=7, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:rsgroup, region=705cd38dcabb731d02b7bdaa205f3177, ASSIGN 2023-07-18 18:15:06,111 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=8, ppid=7, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:rsgroup, region=705cd38dcabb731d02b7bdaa205f3177, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35809,1689704104324; forceNewPlan=false, retain=false 2023-07-18 18:15:06,180 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:06,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93db80e00adf8c41f3e1975699c1a490, NAME => 'hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:06,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:06,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:06,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:06,180 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:06,181 INFO [StoreOpener-93db80e00adf8c41f3e1975699c1a490-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:06,183 DEBUG [StoreOpener-93db80e00adf8c41f3e1975699c1a490-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490/info 2023-07-18 18:15:06,183 DEBUG [StoreOpener-93db80e00adf8c41f3e1975699c1a490-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490/info 2023-07-18 18:15:06,183 INFO [StoreOpener-93db80e00adf8c41f3e1975699c1a490-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93db80e00adf8c41f3e1975699c1a490 columnFamilyName info 2023-07-18 18:15:06,184 INFO [StoreOpener-93db80e00adf8c41f3e1975699c1a490-1] regionserver.HStore(310): Store=93db80e00adf8c41f3e1975699c1a490/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:06,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:06,185 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:06,187 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:06,189 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:06,189 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 93db80e00adf8c41f3e1975699c1a490; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11430623040, jitterRate=0.06455972790718079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:15:06,189 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 93db80e00adf8c41f3e1975699c1a490: 2023-07-18 18:15:06,190 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490., pid=6, masterSystemTime=1689704106176 2023-07-18 18:15:06,192 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:06,192 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:06,192 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=93db80e00adf8c41f3e1975699c1a490, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:06,193 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689704106192"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704106192"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704106192"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704106192"}]},"ts":"1689704106192"} 2023-07-18 18:15:06,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-18 18:15:06,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 93db80e00adf8c41f3e1975699c1a490, server=jenkins-hbase4.apache.org,35809,1689704104324 in 169 msec 2023-07-18 18:15:06,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 18:15:06,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=93db80e00adf8c41f3e1975699c1a490, ASSIGN in 327 msec 2023-07-18 18:15:06,197 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:15:06,197 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704106197"}]},"ts":"1689704106197"} 2023-07-18 18:15:06,198 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 18:15:06,200 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:15:06,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 378 msec 2023-07-18 18:15:06,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 18:15:06,226 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:06,226 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:06,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 18:15:06,236 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:06,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-07-18 18:15:06,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 18:15:06,242 DEBUG [PEWorker-4] procedure.MasterProcedureScheduler(526): NAMESPACE 'hbase', shared lock count=1 2023-07-18 18:15:06,242 DEBUG [PEWorker-4] procedure2.ProcedureExecutor(1400): LOCK_EVENT_WAIT pid=10, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 18:15:06,261 INFO [jenkins-hbase4:44147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:15:06,262 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=8 updating hbase:meta row=705cd38dcabb731d02b7bdaa205f3177, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:06,262 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704106262"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704106262"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704106262"}]},"ts":"1689704106262"} 2023-07-18 18:15:06,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=8, state=RUNNABLE; OpenRegionProcedure 705cd38dcabb731d02b7bdaa205f3177, server=jenkins-hbase4.apache.org,35809,1689704104324}] 2023-07-18 18:15:06,418 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:06,418 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 705cd38dcabb731d02b7bdaa205f3177, NAME => 'hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:06,418 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:15:06,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. service=MultiRowMutationService 2023-07-18 18:15:06,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:rsgroup successfully. 2023-07-18 18:15:06,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table rsgroup 705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:06,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,420 INFO [StoreOpener-705cd38dcabb731d02b7bdaa205f3177-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family m of region 705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,421 DEBUG [StoreOpener-705cd38dcabb731d02b7bdaa205f3177-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177/m 2023-07-18 18:15:06,421 DEBUG [StoreOpener-705cd38dcabb731d02b7bdaa205f3177-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177/m 2023-07-18 18:15:06,422 INFO [StoreOpener-705cd38dcabb731d02b7bdaa205f3177-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 705cd38dcabb731d02b7bdaa205f3177 columnFamilyName m 2023-07-18 18:15:06,422 INFO [StoreOpener-705cd38dcabb731d02b7bdaa205f3177-1] regionserver.HStore(310): Store=705cd38dcabb731d02b7bdaa205f3177/m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:06,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,425 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:06,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:06,428 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 705cd38dcabb731d02b7bdaa205f3177; next sequenceid=2; org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy@7294865e, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:15:06,428 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 705cd38dcabb731d02b7bdaa205f3177: 2023-07-18 18:15:06,428 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177., pid=11, masterSystemTime=1689704106415 2023-07-18 18:15:06,429 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:06,430 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:06,430 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=8 updating hbase:meta row=705cd38dcabb731d02b7bdaa205f3177, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:06,430 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177.","families":{"info":[{"qualifier":"regioninfo","vlen":39,"tag":[],"timestamp":"1689704106430"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704106430"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704106430"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704106430"}]},"ts":"1689704106430"} 2023-07-18 18:15:06,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=8 2023-07-18 18:15:06,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=8, state=SUCCESS; OpenRegionProcedure 705cd38dcabb731d02b7bdaa205f3177, server=jenkins-hbase4.apache.org,35809,1689704104324 in 168 msec 2023-07-18 18:15:06,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=8, resume processing ppid=7 2023-07-18 18:15:06,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, ppid=7, state=SUCCESS; TransitRegionStateProcedure table=hbase:rsgroup, region=705cd38dcabb731d02b7bdaa205f3177, ASSIGN in 323 msec 2023-07-18 18:15:06,440 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:06,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 201 msec 2023-07-18 18:15:06,444 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=7, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:15:06,444 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:rsgroup","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704106444"}]},"ts":"1689704106444"} 2023-07-18 18:15:06,445 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:rsgroup, state=ENABLED in hbase:meta 2023-07-18 18:15:06,447 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=7, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:rsgroup execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:15:06,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateTableProcedure table=hbase:rsgroup in 379 msec 2023-07-18 18:15:06,458 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 18:15:06,461 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 18:15:06,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.682sec 2023-07-18 18:15:06,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 18:15:06,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 18:15:06,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 18:15:06,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1689704104150-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 18:15:06,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44147,1689704104150-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 18:15:06,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 18:15:06,468 DEBUG [Listener at localhost/41213] zookeeper.ReadOnlyZKClient(139): Connect 0x4875d50c to 127.0.0.1:57697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:06,475 DEBUG [Listener at localhost/41213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@357edf8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:06,475 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker(840): RSGroup table=hbase:rsgroup is online, refreshing cached information 2023-07-18 18:15:06,475 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl(534): Refreshing in Online mode. 2023-07-18 18:15:06,478 DEBUG [hconnection-0x5934234d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:15:06,479 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:06,479 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:06,480 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:15:06,481 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 2 2023-07-18 18:15:06,482 INFO [Listener at localhost/41213] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:06,482 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:06,482 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$RSGroupStartupWorker(823): GroupBasedLoadBalancer is now online 2023-07-18 18:15:06,484 DEBUG [Listener at localhost/41213] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 18:15:06,486 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 18:15:06,490 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-18 18:15:06,490 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:06,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(492): Client=jenkins//172.31.14.131 set balanceSwitch=false 2023-07-18 18:15:06,491 DEBUG [Listener at localhost/41213] zookeeper.ReadOnlyZKClient(139): Connect 0x575b56c6 to 127.0.0.1:57697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:06,499 DEBUG [Listener at localhost/41213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f0d392b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:06,500 INFO [Listener at localhost/41213] zookeeper.RecoverableZooKeeper(93): Process identifier=VerifyingRSGroupAdminClient connecting to ZooKeeper ensemble=127.0.0.1:57697 2023-07-18 18:15:06,505 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): VerifyingRSGroupAdminClient0x0, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:15:06,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): VerifyingRSGroupAdminClient-0x10179a503c8000a connected 2023-07-18 18:15:06,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:06,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:06,513 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 1 2023-07-18 18:15:06,531 INFO [Listener at localhost/41213] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:15:06,531 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:06,531 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:06,531 INFO [Listener at localhost/41213] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:15:06,531 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:15:06,532 INFO [Listener at localhost/41213] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:15:06,532 INFO [Listener at localhost/41213] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:15:06,532 INFO [Listener at localhost/41213] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46387 2023-07-18 18:15:06,533 INFO [Listener at localhost/41213] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:15:06,534 DEBUG [Listener at localhost/41213] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:15:06,535 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:06,536 INFO [Listener at localhost/41213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:15:06,537 INFO [Listener at localhost/41213] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46387 connecting to ZooKeeper ensemble=127.0.0.1:57697 2023-07-18 18:15:06,543 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:463870x0, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:15:06,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46387-0x10179a503c8000b connected 2023-07-18 18:15:06,545 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(162): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:15:06,545 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(162): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/running 2023-07-18 18:15:06,546 DEBUG [Listener at localhost/41213] zookeeper.ZKUtil(164): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:15:06,546 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46387 2023-07-18 18:15:06,547 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46387 2023-07-18 18:15:06,547 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46387 2023-07-18 18:15:06,547 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46387 2023-07-18 18:15:06,547 DEBUG [Listener at localhost/41213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46387 2023-07-18 18:15:06,549 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2023-07-18 18:15:06,549 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2023-07-18 18:15:06,549 INFO [Listener at localhost/41213] http.HttpServer(900): Added global filter 'securityheaders' (class=org.apache.hadoop.hbase.http.SecurityHeadersFilter) 2023-07-18 18:15:06,549 INFO [Listener at localhost/41213] http.HttpServer(879): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2023-07-18 18:15:06,550 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2023-07-18 18:15:06,550 INFO [Listener at localhost/41213] http.HttpServer(886): Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2023-07-18 18:15:06,550 INFO [Listener at localhost/41213] http.HttpServer(783): ASYNC_PROFILER_HOME environment variable and async.profiler.home system property not specified. Disabling /prof endpoint. 2023-07-18 18:15:06,550 INFO [Listener at localhost/41213] http.HttpServer(1146): Jetty bound to port 42667 2023-07-18 18:15:06,550 INFO [Listener at localhost/41213] server.Server(375): jetty-9.4.50.v20221201; built: 2022-12-01T22:07:03.915Z; git: da9a0b30691a45daf90a9f17b5defa2f1434f882; jvm 1.8.0_362-b09 2023-07-18 18:15:06,556 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:06,557 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@7d3c5a39{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,AVAILABLE} 2023-07-18 18:15:06,557 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:06,557 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.s.ServletContextHandler@2d37a2b0{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,AVAILABLE} 2023-07-18 18:15:06,677 INFO [Listener at localhost/41213] webapp.StandardDescriptorProcessor(277): NO JSP Support for /, did not find org.apache.hbase.thirdparty.org.eclipse.jetty.jsp.JettyJspServlet 2023-07-18 18:15:06,678 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(334): DefaultSessionIdManager workerName=node0 2023-07-18 18:15:06,678 INFO [Listener at localhost/41213] session.DefaultSessionIdManager(339): No SessionScavenger set, using defaults 2023-07-18 18:15:06,678 INFO [Listener at localhost/41213] session.HouseKeeper(132): node0 Scavenging every 660000ms 2023-07-18 18:15:06,679 INFO [Listener at localhost/41213] http.SecurityHeadersFilter(48): Added security headers filter 2023-07-18 18:15:06,680 INFO [Listener at localhost/41213] handler.ContextHandler(921): Started o.a.h.t.o.e.j.w.WebAppContext@3e8cf2fc{regionserver,/,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/java.io.tmpdir/jetty-0_0_0_0-42667-hbase-server-2_4_18-SNAPSHOT_jar-_-any-1775006412420472357/webapp/,AVAILABLE}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:06,682 INFO [Listener at localhost/41213] server.AbstractConnector(333): Started ServerConnector@134f4aae{HTTP/1.1, (http/1.1)}{0.0.0.0:42667} 2023-07-18 18:15:06,682 INFO [Listener at localhost/41213] server.Server(415): Started @44958ms 2023-07-18 18:15:06,684 INFO [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(951): ClusterId : a130cbca-bf8e-41ac-a28c-83fea467f6eb 2023-07-18 18:15:06,684 DEBUG [RS:3;jenkins-hbase4:46387] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:15:06,686 DEBUG [RS:3;jenkins-hbase4:46387] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:15:06,686 DEBUG [RS:3;jenkins-hbase4:46387] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:15:06,688 DEBUG [RS:3;jenkins-hbase4:46387] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:15:06,691 DEBUG [RS:3;jenkins-hbase4:46387] zookeeper.ReadOnlyZKClient(139): Connect 0x0f0c6c09 to 127.0.0.1:57697 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:15:06,695 DEBUG [RS:3;jenkins-hbase4:46387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cb9398, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2023-07-18 18:15:06,695 DEBUG [RS:3;jenkins-hbase4:46387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f40779, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:15:06,705 DEBUG [RS:3;jenkins-hbase4:46387] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:3;jenkins-hbase4:46387 2023-07-18 18:15:06,705 INFO [RS:3;jenkins-hbase4:46387] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:15:06,705 INFO [RS:3;jenkins-hbase4:46387] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:15:06,705 DEBUG [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:15:06,706 INFO [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44147,1689704104150 with isa=jenkins-hbase4.apache.org/172.31.14.131:46387, startcode=1689704106530 2023-07-18 18:15:06,706 DEBUG [RS:3;jenkins-hbase4:46387] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:15:06,708 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36765, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:15:06,709 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44147] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,709 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(787): Updating default servers. 2023-07-18 18:15:06,709 DEBUG [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a 2023-07-18 18:15:06,709 DEBUG [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32911 2023-07-18 18:15:06,709 DEBUG [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=33611 2023-07-18 18:15:06,714 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:06,714 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:06,714 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:06,714 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:06,714 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:06,715 DEBUG [RS:3;jenkins-hbase4:46387] zookeeper.ZKUtil(162): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,715 WARN [RS:3;jenkins-hbase4:46387] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:15:06,715 INFO [RS:3;jenkins-hbase4:46387] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:15:06,715 DEBUG [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,715 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46387,1689704106530] 2023-07-18 18:15:06,715 DEBUG [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 2 2023-07-18 18:15:06,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:06,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:06,717 INFO [org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150] rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread(792): Updated with servers: 4 2023-07-18 18:15:06,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:06,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:06,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:06,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:06,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:06,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:06,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:06,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,722 DEBUG [RS:3;jenkins-hbase4:46387] zookeeper.ZKUtil(162): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:06,722 DEBUG [RS:3;jenkins-hbase4:46387] zookeeper.ZKUtil(162): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:06,722 DEBUG [RS:3;jenkins-hbase4:46387] zookeeper.ZKUtil(162): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:06,723 DEBUG [RS:3;jenkins-hbase4:46387] zookeeper.ZKUtil(162): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,724 DEBUG [RS:3;jenkins-hbase4:46387] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:15:06,724 INFO [RS:3;jenkins-hbase4:46387] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:15:06,725 INFO [RS:3;jenkins-hbase4:46387] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:15:06,725 INFO [RS:3;jenkins-hbase4:46387] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:15:06,726 INFO [RS:3;jenkins-hbase4:46387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:06,726 INFO [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:15:06,728 INFO [RS:3;jenkins-hbase4:46387] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,729 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,730 DEBUG [RS:3;jenkins-hbase4:46387] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:15:06,731 INFO [RS:3;jenkins-hbase4:46387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:06,731 INFO [RS:3;jenkins-hbase4:46387] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:06,731 INFO [RS:3;jenkins-hbase4:46387] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:06,746 INFO [RS:3;jenkins-hbase4:46387] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:15:06,746 INFO [RS:3;jenkins-hbase4:46387] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46387,1689704106530-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:15:06,758 INFO [RS:3;jenkins-hbase4:46387] regionserver.Replication(203): jenkins-hbase4.apache.org,46387,1689704106530 started 2023-07-18 18:15:06,758 INFO [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46387,1689704106530, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46387, sessionid=0x10179a503c8000b 2023-07-18 18:15:06,759 DEBUG [RS:3;jenkins-hbase4:46387] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:15:06,759 DEBUG [RS:3;jenkins-hbase4:46387] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,759 DEBUG [RS:3;jenkins-hbase4:46387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46387,1689704106530' 2023-07-18 18:15:06,759 DEBUG [RS:3;jenkins-hbase4:46387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:15:06,759 DEBUG [RS:3;jenkins-hbase4:46387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:15:06,760 DEBUG [RS:3;jenkins-hbase4:46387] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:15:06,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:06,761 DEBUG [RS:3;jenkins-hbase4:46387] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:15:06,764 DEBUG [RS:3;jenkins-hbase4:46387] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:06,764 DEBUG [RS:3;jenkins-hbase4:46387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46387,1689704106530' 2023-07-18 18:15:06,764 DEBUG [RS:3;jenkins-hbase4:46387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:15:06,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:06,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:06,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:06,767 DEBUG [RS:3;jenkins-hbase4:46387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:15:06,769 DEBUG [RS:3;jenkins-hbase4:46387] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:15:06,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:06,769 INFO [RS:3;jenkins-hbase4:46387] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:15:06,769 INFO [RS:3;jenkins-hbase4:46387] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:15:06,771 DEBUG [hconnection-0x552ab686-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:15:06,772 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:15:06,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:06,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:06,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:06,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:06,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 20 service: MasterService methodName: ExecMasterService size: 118 connection: 172.31.14.131:48796 deadline: 1689705306779, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:06,780 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:06,781 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:06,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:06,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:06,782 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:06,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:06,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:06,830 INFO [Listener at localhost/41213] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testRSGroupListDoesNotContainFailedTableCreation Thread=557 (was 523) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.FSNamesystem$NameNodeResourceMonitor@66ba58da java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.FSNamesystem$NameNodeResourceMonitor.run(FSNamesystem.java:3842) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.server.blockmanagement.PendingReplicationBlocks$PendingReplicationMonitor@22bbfe23 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.blockmanagement.PendingReplicationBlocks$PendingReplicationMonitor.run(PendingReplicationBlocks.java:244) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1992892728-2363 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1992892728-2360 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-548-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f4ce28c-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=1,queue=0,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: IPC Server handler 1 on default port 35477 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp976075850-2352 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp912985556-2627 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741832_1008, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-567-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x575b56c6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:32911 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x4875d50c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: Listener at localhost/41213-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: VolumeScannerThread(/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data1) java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.VolumeScanner.run(VolumeScanner.java:627) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp774357224-2317-acceptor-0@22d045c2-ServerConnector@6d04da20{HTTP/1.1, (http/1.1)}{0.0.0.0:44737} sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.hbase.thirdparty.org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:388) org.apache.hbase.thirdparty.org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:704) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_860416522_17 at /127.0.0.1:55306 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741829_1005] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x29eac85c-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x6f4ce28c-metaLookup-shared--pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_860416522_17 at /127.0.0.1:40858 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741829_1005] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@5daf6e09 sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:113) org.apache.hadoop.hdfs.net.TcpPeerServer.accept(TcpPeerServer.java:85) org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:145) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp912985556-2623 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x575b56c6-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: Timer-35 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: pool-552-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x049601de sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f4ce28c-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: VolumeScannerThread(/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data6) java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.VolumeScanner.run(VolumeScanner.java:627) Potentially hanging thread: Timer-24 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: IPC Server handler 1 on default port 37933 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data2/current/BP-534196876-172.31.14.131-1689704103357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.CachingGetSpaceUsed$RefreshThread.run(CachingGetSpaceUsed.java:179) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: Timer-30 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: Listener at localhost/41213-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: IPC Server idle connection scanner for port 35477 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Server handler 4 on default port 32911 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: org.apache.hadoop.util.JvmPauseMonitor$Monitor@1d7abbee java.lang.Thread.sleep(Native Method) org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:192) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp912985556-2628 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 0 on default port 35477 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: Session-HouseKeeper-5af53e15-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: VolumeScannerThread(/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data3) java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.VolumeScanner.run(VolumeScanner.java:627) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data1/current/BP-534196876-172.31.14.131-1689704103357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.CachingGetSpaceUsed$RefreshThread.run(CachingGetSpaceUsed.java:179) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a-prefix:jenkins-hbase4.apache.org,35809,1689704104324.meta sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp353748819-2261 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:34101 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: 267518829@qtp-524088327-0 java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Potentially hanging thread: org.apache.hadoop.util.JvmPauseMonitor$Monitor@3bdb6fe java.lang.Thread.sleep(Native Method) org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:192) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer-25 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=1,queue=0,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: IPC Server handler 3 on default port 41213 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a-prefix:jenkins-hbase4.apache.org,35809,1689704104324 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1252716609_17 at /127.0.0.1:47664 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741833_1009] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber@105e13de java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.run(FSNamesystem.java:3975) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 2 on default port 32911 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp774357224-2323 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:47656 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741831_1007] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp912985556-2630 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:32911 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp912985556-2626 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: 749260906@qtp-1334008484-0 java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Potentially hanging thread: Session-HouseKeeper-508d202c-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.FSNamesystem$NameNodeEditLogRoller@1706e5e4 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.FSNamesystem$NameNodeEditLogRoller.run(FSNamesystem.java:3884) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:47684 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741835_1011] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1992892728-2364 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741835_1011, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=0,queue=0,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.IncrementalBlockReportManager.waitTillNextIBR(IncrementalBlockReportManager.java:158) org.apache.hadoop.hdfs.server.datanode.BPServiceActor.offerService(BPServiceActor.java:715) org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:846) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.metaPriority.FPBQ.Fifo.handler=0,queue=0,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: java.util.concurrent.ThreadPoolExecutor$Worker@19f6cfd4[State = -1, empty queue] sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:55274 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1992892728-2358 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: M:0;jenkins-hbase4:44147 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:81) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:64) org.apache.hadoop.hbase.master.HMaster.waitForMasterActive(HMaster.java:634) org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:957) org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:904) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1006) org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:541) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: IPC Server handler 0 on default port 37933 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32911 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: VolumeScannerThread(/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data4) java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.VolumeScanner.run(VolumeScanner.java:627) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:32911 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: qtp976075850-2346 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:3;jenkins-hbase4:46387 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:81) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:64) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1092) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:175) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:123) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:159) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:360) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1873) org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:319) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:156) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: CacheReplicationMonitor(636446957) sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2163) org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor.run(CacheReplicationMonitor.java:181) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704104975 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$1.run(HFileCleaner.java:236) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:40884 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741831_1007] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58836@0x34a7cc7e sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741829_1005, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1916015537-2291 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 3 on default port 32911 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: Timer-29 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: qtp353748819-2255 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x77bee678 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: 1102316695@qtp-1334008484-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43355 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498) org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192) org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124) org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Potentially hanging thread: IPC Server handler 1 on default port 41213 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:34101 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase4:46387Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33663-SendThread(127.0.0.1:58836) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:369) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1137) Potentially hanging thread: org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,38247,1689704098505 java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread.run(RSGroupInfoManagerImpl.java:797) Potentially hanging thread: pool-571-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: hconnection-0x6f4ce28c-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1125028908_17 at /127.0.0.1:55332 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741832_1008] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x049601de-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741829_1005, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp912985556-2625 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:32911 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x4875d50c-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Session-HouseKeeper-5ca65b20-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1916015537-2290 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x3b126027-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: jenkins-hbase4:40393Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: 734604950@qtp-524088327-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46213 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498) org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192) org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124) org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Potentially hanging thread: 1790959576@qtp-924848190-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41681 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498) org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192) org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124) org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:32911 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x3b126027 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:1;jenkins-hbase4:46305 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:81) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:64) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1092) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:175) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:123) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:159) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:360) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1873) org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:319) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:156) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:34101 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.util.JvmPauseMonitor$Monitor@35814f34 java.lang.Thread.sleep(Native Method) org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:192) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741835_1011, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp774357224-2316 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704104975 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$2.run(HFileCleaner.java:251) Potentially hanging thread: Listener at localhost/33663-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: VolumeScannerThread(/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data5) java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.VolumeScanner.run(VolumeScanner.java:627) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x049601de-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1125028908_17 at /127.0.0.1:40888 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741832_1008] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x3b126027-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: IPC Server handler 3 on default port 35477 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x575b56c6-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data5/current/BP-534196876-172.31.14.131-1689704103357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.CachingGetSpaceUsed$RefreshThread.run(CachingGetSpaceUsed.java:179) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp774357224-2318 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1252716609_17 at /127.0.0.1:55340 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741833_1009] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1916015537-2286 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x77bee678-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS:0;jenkins-hbase4:35809 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:81) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:64) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1092) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:175) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:123) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:159) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:360) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1873) org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:319) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:156) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: 1680326028@qtp-924848190-0 java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_860416522_17 at /127.0.0.1:47642 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741829_1005] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: IPC Server idle connection scanner for port 32911 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741831_1007, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741831_1007, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:803) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData-prefix:jenkins-hbase4.apache.org,44147,1689704104150 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp353748819-2258 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: hconnection-0x6f4ce28c-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server idle connection scanner for port 41213 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:34101 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp774357224-2319 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:40820 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58836@0x34a7cc7e-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer-26 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 4 on default port 41213 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 2 on default port 35477 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: qtp1992892728-2359 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x29eac85c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: Listener at localhost/41213-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=0,queue=0,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp1992892728-2357 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:183) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:606) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) org.apache.hbase.thirdparty.org.eclipse.jetty.io.ManagedSelector$$Lambda$75/741838246.run(Unknown Source) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a-prefix:jenkins-hbase4.apache.org,46305,1689704104476 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data6/current/BP-534196876-172.31.14.131-1689704103357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.CachingGetSpaceUsed$RefreshThread.run(CachingGetSpaceUsed.java:179) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x6f4ce28c-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 1 on default port 32911 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x29eac85c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741831_1007, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp353748819-2256-acceptor-0@370dee67-ServerConnector@50e3498a{HTTP/1.1, (http/1.1)}{0.0.0.0:33611} sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.hbase.thirdparty.org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:388) org.apache.hbase.thirdparty.org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:704) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Session-HouseKeeper-239ed2ad-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:32911 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: VolumeScannerThread(/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data2) java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.VolumeScanner.run(VolumeScanner.java:627) Potentially hanging thread: org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@40c50e37 sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:113) org.apache.hadoop.hdfs.net.TcpPeerServer.accept(TcpPeerServer.java:85) org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:145) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:35809-longCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-546-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp912985556-2629 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread-jenkins-hbase4.apache.org,44147,1689704104150 java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hbase.rsgroup.RSGroupInfoManagerImpl$ServerEventsListenerThread.run(RSGroupInfoManagerImpl.java:797) Potentially hanging thread: pool-551-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741833_1009, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=1,queue=0,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:32911 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: pool-557-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1916015537-2288 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=0,queue=0,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data4/current/BP-534196876-172.31.14.131-1689704103357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.CachingGetSpaceUsed$RefreshThread.run(CachingGetSpaceUsed.java:179) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552ab686-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 2 on default port 41213 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: qtp976075850-2347-acceptor-0@28d48e48-ServerConnector@72f6fde0{HTTP/1.1, (http/1.1)}{0.0.0.0:32879} sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.hbase.thirdparty.org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:388) org.apache.hbase.thirdparty.org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:704) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.metaPriority.FPBQ.Fifo.handler=0,queue=0,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: org.apache.hadoop.util.JvmPauseMonitor$Monitor@59835f98 java.lang.Thread.sleep(Native Method) org.apache.hadoop.util.JvmPauseMonitor$Monitor.run(JvmPauseMonitor.java:192) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: qtp976075850-2349 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: java.util.concurrent.ThreadPoolExecutor$Worker@79d5bf3d[State = -1, empty queue] sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x0f0c6c09-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-566-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x0f0c6c09-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: java.util.concurrent.ThreadPoolExecutor$Worker@43b721e7[State = -1, empty queue] sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=1,queue=0,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp1916015537-2292 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 0 on default port 32911 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: qtp353748819-2262 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:55324 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741831_1007] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp774357224-2320 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.server.datanode.DataXceiverServer@69bdef2a sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:113) org.apache.hadoop.hdfs.net.TcpPeerServer.accept(TcpPeerServer.java:85) org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:145) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp353748819-2259 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1992892728-2361-acceptor-0@4a90b477-ServerConnector@780ec191{HTTP/1.1, (http/1.1)}{0.0.0.0:45539} sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.hbase.thirdparty.org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:388) org.apache.hbase.thirdparty.org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:704) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ProcessThread(sid:0 cport:57697): sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:134) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741833_1009, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58836@0x34a7cc7e-SendThread(127.0.0.1:58836) java.lang.Thread.sleep(Native Method) org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:369) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1137) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:32911 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a-prefix:jenkins-hbase4.apache.org,40393,1689704104623 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server idle connection scanner for port 37933 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS:3;jenkins-hbase4:46387-longCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5934234d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:2;jenkins-hbase4:40393 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:81) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:64) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1092) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:175) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:123) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:159) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:360) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1873) org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:319) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:156) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f4ce28c-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase4:35809Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 4 on default port 37933 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: Timer-32 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741832_1008, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp774357224-2321 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=1,queue=0,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741832_1008, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=0,queue=0,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: NIOServerCxnFactory.AcceptThread:localhost/127.0.0.1:57697 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.select(NIOServerCnxnFactory.java:229) org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.run(NIOServerCnxnFactory.java:205) Potentially hanging thread: Listener at localhost/41213.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/41213-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: 2058842548@qtp-195320339-0 java.lang.Object.wait(Native Method) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:626) Potentially hanging thread: Timer-27 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data3/current/BP-534196876-172.31.14.131-1689704103357 java.lang.Thread.sleep(Native Method) org.apache.hadoop.fs.CachingGetSpaceUsed$RefreshThread.run(CachingGetSpaceUsed.java:179) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: 1387842992@qtp-195320339-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33473 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:498) org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:192) org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124) org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 2 on default port 37933 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: Listener at localhost/41213-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Session-HouseKeeper-3ff34e7b-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x552ab686-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp976075850-2351 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741829_1005, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase4:46305Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: qtp353748819-2260 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp976075850-2353 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp976075850-2348 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp912985556-2624-acceptor-0@3f868650-ServerConnector@134f4aae{HTTP/1.1, (http/1.1)}{0.0.0.0:42667} sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.hbase.thirdparty.org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:388) org.apache.hbase.thirdparty.org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:704) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 0 on default port 41213 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x77bee678-SendThread(127.0.0.1:57697) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:32911 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp774357224-2322 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.metaPriority.FPBQ.Fifo.handler=0,queue=0,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RS:2;jenkins-hbase4:40393-longCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:803) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp353748819-2257 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1125028908_17 at /127.0.0.1:47660 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741832_1008] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: Listener at localhost/41213-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:34101 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: qtp1916015537-2289 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1252716609_17 at /127.0.0.1:40892 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741833_1009] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=0,queue=0,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741835_1011, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:1;jenkins-hbase4:46305-longCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1916015537-2287-acceptor-0@17f45994-ServerConnector@6ba4dce4{HTTP/1.1, (http/1.1)}{0.0.0.0:42835} sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:421) sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:249) org.apache.hbase.thirdparty.org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:388) org.apache.hbase.thirdparty.org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:704) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: Listener at localhost/41213.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Server handler 4 on default port 35477 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: pool-553-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6f4ce28c-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34101 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: PacketResponder: BP-534196876-172.31.14.131-1689704103357:blk_1073741833_1009, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-558-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Server handler 3 on default port 37933 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) org.apache.hadoop.ipc.CallQueueManager.take(CallQueueManager.java:294) org.apache.hadoop.ipc.Server$Handler.run(Server.java:2799) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=46387 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: org.apache.hadoop.hdfs.server.blockmanagement.HeartbeatManager$Monitor@164e4df3 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.blockmanagement.HeartbeatManager$Monitor.run(HeartbeatManager.java:451) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:55356 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741835_1011] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: pool-562-thread-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35809 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:40908 [Receiving block BP-534196876-172.31.14.131-1689704103357:blk_1073741835_1011] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1916015537-2293 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp976075850-2350 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:34101 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Timer-34 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Timer-28 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: jenkins-hbase4:44147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.master.assignment.AssignmentManager.waitOnAssignQueue(AssignmentManager.java:2102) org.apache.hadoop.hbase.master.assignment.AssignmentManager.processAssignQueue(AssignmentManager.java:2124) org.apache.hadoop.hbase.master.assignment.AssignmentManager.access$600(AssignmentManager.java:104) org.apache.hadoop.hbase.master.assignment.AssignmentManager$1.run(AssignmentManager.java:2064) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:34101 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: qtp1992892728-2362 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) org.apache.hbase.thirdparty.org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974) org.apache.hbase.thirdparty.org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.IncrementalBlockReportManager.waitTillNextIBR(IncrementalBlockReportManager.java:158) org.apache.hadoop.hdfs.server.datanode.BPServiceActor.offerService(BPServiceActor.java:715) org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:846) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: Timer-33 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.hdfs.server.namenode.LeaseManager$Monitor@443e44f8 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.server.namenode.LeaseManager$Monitor.run(LeaseManager.java:528) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x4875d50c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.server.datanode.IncrementalBlockReportManager.waitTillNextIBR(IncrementalBlockReportManager.java:158) org.apache.hadoop.hdfs.server.datanode.BPServiceActor.offerService(BPServiceActor.java:715) org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:846) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:803) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1464173292) connection to localhost/127.0.0.1:34101 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_828600759_17 at /127.0.0.1:47732 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.metaPriority.FPBQ.Fifo.handler=0,queue=0,port=40393 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.metaPriority.FPBQ.Fifo.handler=0,queue=0,port=46305 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: Timer-31 java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:57697@0x0f0c6c09 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$93/1237189330.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41213.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=834 (was 830) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=428 (was 432), ProcessCount=173 (was 173), AvailableMemoryMB=2728 (was 2962) 2023-07-18 18:15:06,833 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=557 is superior to 500 2023-07-18 18:15:06,851 INFO [Listener at localhost/41213] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testNotMoveTableToNullRSGroupWhenCreatingExistingTable Thread=557, OpenFileDescriptor=834, MaxFileDescriptor=60000, SystemLoadAverage=428, ProcessCount=173, AvailableMemoryMB=2727 2023-07-18 18:15:06,851 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=557 is superior to 500 2023-07-18 18:15:06,851 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(132): testNotMoveTableToNullRSGroupWhenCreatingExistingTable 2023-07-18 18:15:06,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:06,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:06,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:06,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:06,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:06,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:06,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:06,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:15:06,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:06,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:15:06,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:06,864 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:15:06,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:06,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:06,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:06,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:06,871 INFO [RS:3;jenkins-hbase4:46387] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46387%2C1689704106530, suffix=, logDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,46387,1689704106530, archiveDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs, maxLogs=32 2023-07-18 18:15:06,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:06,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:06,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:06,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:06,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:06,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 48 service: MasterService methodName: ExecMasterService size: 118 connection: 172.31.14.131:48796 deadline: 1689705306876, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:06,877 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:06,879 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:06,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:06,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:06,880 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:06,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:06,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:06,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 't1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:06,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=t1 2023-07-18 18:15:06,886 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=t1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:15:06,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "t1" procId is: 12 2023-07-18 18:15:06,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:15:06,888 DEBUG [PEWorker-1] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:06,890 DEBUG [PEWorker-1] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:06,890 DEBUG [PEWorker-1] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:06,891 WARN [IPC Server handler 3 on default port 32911] blockmanagement.BlockPlacementPolicyDefault(446): Failed to place enough replicas, still in need of 1 to reach 3 (unavailableStorages=[], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) For more information, please enable DEBUG log level on org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy and org.apache.hadoop.net.NetworkTopology 2023-07-18 18:15:06,892 WARN [IPC Server handler 3 on default port 32911] protocol.BlockStoragePolicy(161): Failed to place enough replicas: expected size is 1 but only 0 storage types can be selected (replication=3, selected=[], unavailable=[DISK], removed=[DISK], policy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}) 2023-07-18 18:15:06,892 WARN [IPC Server handler 3 on default port 32911] blockmanagement.BlockPlacementPolicyDefault(446): Failed to place enough replicas, still in need of 1 to reach 3 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]} 2023-07-18 18:15:06,894 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=t1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:15:06,899 DEBUG [RS-EventLoopGroup-16-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK] 2023-07-18 18:15:06,899 DEBUG [RS-EventLoopGroup-16-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK] 2023-07-18 18:15:06,900 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:06,900 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b empty. 2023-07-18 18:15:06,901 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:06,901 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived t1 regions 2023-07-18 18:15:06,901 INFO [RS:3;jenkins-hbase4:46387] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,46387,1689704106530/jenkins-hbase4.apache.org%2C46387%2C1689704106530.1689704106871 2023-07-18 18:15:06,902 DEBUG [RS:3;jenkins-hbase4:46387] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37305,DS-ed4c20e1-798a-4849-a08b-af1750185191,DISK], DatanodeInfoWithStorage[127.0.0.1:40845,DS-52c9e3d6-49f0-4d94-b719-198b4db8a3c5,DISK]] 2023-07-18 18:15:06,918 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/.tabledesc/.tableinfo.0000000001 2023-07-18 18:15:06,920 INFO [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d4cc1bbcbf84d2104725444cb38d847b, NAME => 't1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='t1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp 2023-07-18 18:15:06,935 DEBUG [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(866): Instantiated t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:06,935 DEBUG [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(1604): Closing d4cc1bbcbf84d2104725444cb38d847b, disabling compactions & flushes 2023-07-18 18:15:06,935 INFO [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(1626): Closing region t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:06,935 DEBUG [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:06,935 DEBUG [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(1714): Acquired close lock on t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. after waiting 0 ms 2023-07-18 18:15:06,935 DEBUG [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(1724): Updates disabled for region t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:06,935 INFO [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(1838): Closed t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:06,935 DEBUG [RegionOpenAndInit-t1-pool-0] regionserver.HRegion(1558): Region close journal for d4cc1bbcbf84d2104725444cb38d847b: 2023-07-18 18:15:06,940 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=t1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:15:06,941 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704106941"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704106941"}]},"ts":"1689704106941"} 2023-07-18 18:15:06,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:15:06,947 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=t1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:15:06,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704106947"}]},"ts":"1689704106947"} 2023-07-18 18:15:06,948 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=t1, state=ENABLING in hbase:meta 2023-07-18 18:15:06,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:15:06,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:15:06,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:15:06,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:15:06,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 0 2023-07-18 18:15:06,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:15:06,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1, region=d4cc1bbcbf84d2104725444cb38d847b, ASSIGN}] 2023-07-18 18:15:06,953 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=t1, region=d4cc1bbcbf84d2104725444cb38d847b, ASSIGN 2023-07-18 18:15:06,954 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=t1, region=d4cc1bbcbf84d2104725444cb38d847b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40393,1689704104623; forceNewPlan=false, retain=false 2023-07-18 18:15:06,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:15:07,105 INFO [jenkins-hbase4:44147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:15:07,106 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d4cc1bbcbf84d2104725444cb38d847b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:07,106 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704107106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704107106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704107106"}]},"ts":"1689704107106"} 2023-07-18 18:15:07,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure d4cc1bbcbf84d2104725444cb38d847b, server=jenkins-hbase4.apache.org,40393,1689704104623}] 2023-07-18 18:15:07,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:15:07,260 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:07,261 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:15:07,262 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:15:07,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:07,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d4cc1bbcbf84d2104725444cb38d847b, NAME => 't1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:15:07,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table t1 d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:15:07,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,268 INFO [StoreOpener-d4cc1bbcbf84d2104725444cb38d847b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf1 of region d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,269 DEBUG [StoreOpener-d4cc1bbcbf84d2104725444cb38d847b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b/cf1 2023-07-18 18:15:07,270 DEBUG [StoreOpener-d4cc1bbcbf84d2104725444cb38d847b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b/cf1 2023-07-18 18:15:07,270 INFO [StoreOpener-d4cc1bbcbf84d2104725444cb38d847b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4cc1bbcbf84d2104725444cb38d847b columnFamilyName cf1 2023-07-18 18:15:07,270 INFO [StoreOpener-d4cc1bbcbf84d2104725444cb38d847b-1] regionserver.HStore(310): Store=d4cc1bbcbf84d2104725444cb38d847b/cf1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:15:07,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:15:07,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d4cc1bbcbf84d2104725444cb38d847b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=11828073920, jitterRate=0.10157522559165955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:15:07,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d4cc1bbcbf84d2104725444cb38d847b: 2023-07-18 18:15:07,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b., pid=14, masterSystemTime=1689704107260 2023-07-18 18:15:07,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:07,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:07,292 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d4cc1bbcbf84d2104725444cb38d847b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:07,292 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704107292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689704107292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689704107292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689704107292"}]},"ts":"1689704107292"} 2023-07-18 18:15:07,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-18 18:15:07,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure d4cc1bbcbf84d2104725444cb38d847b, server=jenkins-hbase4.apache.org,40393,1689704104623 in 187 msec 2023-07-18 18:15:07,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-18 18:15:07,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=t1, region=d4cc1bbcbf84d2104725444cb38d847b, ASSIGN in 344 msec 2023-07-18 18:15:07,299 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=t1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:15:07,299 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704107299"}]},"ts":"1689704107299"} 2023-07-18 18:15:07,301 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=t1, state=ENABLED in hbase:meta 2023-07-18 18:15:07,305 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=t1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:15:07,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=t1 in 422 msec 2023-07-18 18:15:07,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:15:07,491 INFO [Listener at localhost/41213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:t1, procId: 12 completed 2023-07-18 18:15:07,491 DEBUG [Listener at localhost/41213] hbase.HBaseTestingUtility(3430): Waiting until all regions of table t1 get assigned. Timeout = 60000ms 2023-07-18 18:15:07,491 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:07,493 INFO [Listener at localhost/41213] hbase.HBaseTestingUtility(3484): All regions for table t1 assigned to meta. Checking AM states. 2023-07-18 18:15:07,493 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:07,493 INFO [Listener at localhost/41213] hbase.HBaseTestingUtility(3504): All regions for table t1 assigned. 2023-07-18 18:15:07,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 't1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:15:07,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=t1 2023-07-18 18:15:07,498 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=t1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:15:07,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableExistsException: t1 at org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.prepareCreate(CreateTableProcedure.java:243) at org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:85) at org.apache.hadoop.hbase.master.procedure.CreateTableProcedure.executeFromState(CreateTableProcedure.java:53) at org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:188) at org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:922) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1646) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-18 18:15:07,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 65 service: MasterService methodName: CreateTable size: 353 connection: 172.31.14.131:48796 deadline: 1689704167494, exception=org.apache.hadoop.hbase.TableExistsException: t1 2023-07-18 18:15:07,500 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [5,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:07,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1528): Rolled back pid=15, state=ROLLEDBACK, exception=org.apache.hadoop.hbase.TableExistsException via master-create-table:org.apache.hadoop.hbase.TableExistsException: t1; CreateTableProcedure table=t1 exec-time=6 msec 2023-07-18 18:15:07,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:07,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:07,603 INFO [Listener at localhost/41213] client.HBaseAdmin$15(890): Started disable of t1 2023-07-18 18:15:07,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable t1 2023-07-18 18:15:07,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=16, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=t1 2023-07-18 18:15:07,608 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704107608"}]},"ts":"1689704107608"} 2023-07-18 18:15:07,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-18 18:15:07,610 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=t1, state=DISABLING in hbase:meta 2023-07-18 18:15:07,612 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set t1 to state=DISABLING 2023-07-18 18:15:07,613 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=t1, region=d4cc1bbcbf84d2104725444cb38d847b, UNASSIGN}] 2023-07-18 18:15:07,613 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=16, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=t1, region=d4cc1bbcbf84d2104725444cb38d847b, UNASSIGN 2023-07-18 18:15:07,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d4cc1bbcbf84d2104725444cb38d847b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:07,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704107614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689704107614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689704107614"}]},"ts":"1689704107614"} 2023-07-18 18:15:07,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=17, state=RUNNABLE; CloseRegionProcedure d4cc1bbcbf84d2104725444cb38d847b, server=jenkins-hbase4.apache.org,40393,1689704104623}] 2023-07-18 18:15:07,634 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver 2023-07-18 18:15:07,634 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver Metrics about HBase MasterObservers 2023-07-18 18:15:07,634 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:15:07,634 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 18:15:07,634 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint 2023-07-18 18:15:07,634 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint Metrics about HBase MasterObservers 2023-07-18 18:15:07,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-18 18:15:07,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d4cc1bbcbf84d2104725444cb38d847b, disabling compactions & flushes 2023-07-18 18:15:07,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:07,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:07,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. after waiting 0 ms 2023-07-18 18:15:07,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:07,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-18 18:15:07,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b. 2023-07-18 18:15:07,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d4cc1bbcbf84d2104725444cb38d847b: 2023-07-18 18:15:07,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,774 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d4cc1bbcbf84d2104725444cb38d847b, regionState=CLOSED 2023-07-18 18:15:07,774 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.","families":{"info":[{"qualifier":"regioninfo","vlen":36,"tag":[],"timestamp":"1689704107774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689704107774"}]},"ts":"1689704107774"} 2023-07-18 18:15:07,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=17 2023-07-18 18:15:07,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=17, state=SUCCESS; CloseRegionProcedure d4cc1bbcbf84d2104725444cb38d847b, server=jenkins-hbase4.apache.org,40393,1689704104623 in 159 msec 2023-07-18 18:15:07,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-18 18:15:07,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; TransitRegionStateProcedure table=t1, region=d4cc1bbcbf84d2104725444cb38d847b, UNASSIGN in 163 msec 2023-07-18 18:15:07,778 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"t1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689704107778"}]},"ts":"1689704107778"} 2023-07-18 18:15:07,779 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=t1, state=DISABLED in hbase:meta 2023-07-18 18:15:07,782 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set t1 to state=DISABLED 2023-07-18 18:15:07,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, state=SUCCESS; DisableTableProcedure table=t1 in 180 msec 2023-07-18 18:15:07,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=16 2023-07-18 18:15:07,911 INFO [Listener at localhost/41213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:t1, procId: 16 completed 2023-07-18 18:15:07,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete t1 2023-07-18 18:15:07,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=t1 2023-07-18 18:15:07,914 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=19, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=t1 2023-07-18 18:15:07,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint(577): Removing deleted table 't1' from rsgroup 'default' 2023-07-18 18:15:07,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=19, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=t1 2023-07-18 18:15:07,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:07,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:07,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:07,919 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,920 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b/cf1, FileablePath, hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b/recovered.edits] 2023-07-18 18:15:07,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-18 18:15:07,925 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b/recovered.edits/4.seqid to hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/archive/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b/recovered.edits/4.seqid 2023-07-18 18:15:07,926 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/.tmp/data/default/t1/d4cc1bbcbf84d2104725444cb38d847b 2023-07-18 18:15:07,926 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived t1 regions 2023-07-18 18:15:07,928 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=19, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=t1 2023-07-18 18:15:07,930 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of t1 from hbase:meta 2023-07-18 18:15:07,933 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 't1' descriptor. 2023-07-18 18:15:07,934 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=19, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=t1 2023-07-18 18:15:07,934 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 't1' from region states. 2023-07-18 18:15:07,934 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"t1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689704107934"}]},"ts":"9223372036854775807"} 2023-07-18 18:15:07,935 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 18:15:07,935 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d4cc1bbcbf84d2104725444cb38d847b, NAME => 't1,,1689704106882.d4cc1bbcbf84d2104725444cb38d847b.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 18:15:07,935 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 't1' as deleted. 2023-07-18 18:15:07,935 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"t1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689704107935"}]},"ts":"9223372036854775807"} 2023-07-18 18:15:07,937 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table t1 state from META 2023-07-18 18:15:07,938 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=19, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=t1 2023-07-18 18:15:07,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; DeleteTableProcedure table=t1 in 26 msec 2023-07-18 18:15:08,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-18 18:15:08,026 INFO [Listener at localhost/41213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:t1, procId: 19 completed 2023-07-18 18:15:08,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:08,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:08,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:08,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:08,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:08,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:15:08,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:15:08,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,045 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:15:08,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:08,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:08,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:08,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 105 service: MasterService methodName: ExecMasterService size: 118 connection: 172.31.14.131:48796 deadline: 1689705308055, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:08,056 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:08,062 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:08,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,063 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:08,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:08,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:08,084 INFO [Listener at localhost/41213] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testNotMoveTableToNullRSGroupWhenCreatingExistingTable Thread=567 (was 557) - Thread LEAK? -, OpenFileDescriptor=842 (was 834) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=428 (was 428), ProcessCount=173 (was 173), AvailableMemoryMB=2729 (was 2727) - AvailableMemoryMB LEAK? - 2023-07-18 18:15:08,085 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=567 is superior to 500 2023-07-18 18:15:08,102 INFO [Listener at localhost/41213] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testNonExistentTableMove Thread=567, OpenFileDescriptor=842, MaxFileDescriptor=60000, SystemLoadAverage=428, ProcessCount=173, AvailableMemoryMB=2728 2023-07-18 18:15:08,102 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=567 is superior to 500 2023-07-18 18:15:08,102 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(132): testNonExistentTableMove 2023-07-18 18:15:08,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:08,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:08,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:08,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:08,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:08,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:15:08,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:15:08,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,114 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:15:08,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:08,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:08,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:08,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 133 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:48796 deadline: 1689705308123, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:08,123 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:08,125 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:08,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,126 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:08,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:08,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:08,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=GrouptestNonExistentTableMove 2023-07-18 18:15:08,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:15:08,128 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsAdmin1(389): Moving table GrouptestNonExistentTableMove to default 2023-07-18 18:15:08,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(184): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, table=GrouptestNonExistentTableMove 2023-07-18 18:15:08,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfoOfTable 2023-07-18 18:15:08,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:08,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:08,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:08,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:08,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:08,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:15:08,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:15:08,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,143 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:15:08,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:08,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:08,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:08,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 168 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:48796 deadline: 1689705308152, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:08,152 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:08,154 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:08,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,155 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:08,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:08,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:08,172 INFO [Listener at localhost/41213] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testNonExistentTableMove Thread=569 (was 567) - Thread LEAK? -, OpenFileDescriptor=842 (was 842), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=428 (was 428), ProcessCount=173 (was 173), AvailableMemoryMB=2728 (was 2728) 2023-07-18 18:15:08,172 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=569 is superior to 500 2023-07-18 18:15:08,189 INFO [Listener at localhost/41213] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testGroupInfoMultiAccessing Thread=569, OpenFileDescriptor=842, MaxFileDescriptor=60000, SystemLoadAverage=428, ProcessCount=173, AvailableMemoryMB=2728 2023-07-18 18:15:08,189 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=569 is superior to 500 2023-07-18 18:15:08,189 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(132): testGroupInfoMultiAccessing 2023-07-18 18:15:08,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:08,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:08,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:08,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:08,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:08,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:15:08,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:15:08,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,204 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:15:08,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:08,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:08,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:08,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 196 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:48796 deadline: 1689705308213, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:08,213 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:08,215 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:08,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,216 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:08,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:08,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:08,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:08,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:08,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:08,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:08,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:08,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:15:08,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:15:08,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,231 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:15:08,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:08,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:08,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:08,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 224 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:48796 deadline: 1689705308239, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:08,239 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:08,241 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:08,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,242 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:08,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:08,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:08,259 INFO [Listener at localhost/41213] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testGroupInfoMultiAccessing Thread=570 (was 569) - Thread LEAK? -, OpenFileDescriptor=842 (was 842), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=428 (was 428), ProcessCount=173 (was 173), AvailableMemoryMB=2728 (was 2728) 2023-07-18 18:15:08,259 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=570 is superior to 500 2023-07-18 18:15:08,279 INFO [Listener at localhost/41213] hbase.ResourceChecker(147): before: rsgroup.TestRSGroupsAdmin1#testNamespaceConstraint Thread=570, OpenFileDescriptor=842, MaxFileDescriptor=60000, SystemLoadAverage=428, ProcessCount=173, AvailableMemoryMB=2728 2023-07-18 18:15:08,279 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=570 is superior to 500 2023-07-18 18:15:08,279 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(132): testNamespaceConstraint 2023-07-18 18:15:08,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:08,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:08,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:08,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:08,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:08,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:15:08,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:15:08,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,291 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:15:08,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:08,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:08,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:08,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 252 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:48796 deadline: 1689705308301, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:08,301 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.setUpBeforeMethod(TestRSGroupsBase.java:136) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.beforeMethod(TestRSGroupsAdmin1.java:86) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:08,303 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:08,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,304 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:08,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:08,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:08,305 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsAdmin1(154): testNamespaceConstraint 2023-07-18 18:15:08,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup Group_foo 2023-07-18 18:15:08,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_foo 2023-07-18 18:15:08,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 6 2023-07-18 18:15:08,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'Group_foo', hbase.rsgroup.name => 'Group_foo'} 2023-07-18 18:15:08,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=Group_foo 2023-07-18 18:15:08,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=20 2023-07-18 18:15:08,323 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:08,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; CreateNamespaceProcedure, namespace=Group_foo in 9 msec 2023-07-18 18:15:08,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=20 2023-07-18 18:15:08,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup Group_foo 2023-07-18 18:15:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup Group_foo is referenced by namespace: Group_foo at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.removeRSGroup(RSGroupAdminServer.java:504) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.removeRSGroup(RSGroupAdminEndpoint.java:278) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16208) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 268 service: MasterService methodName: ExecMasterService size: 91 connection: 172.31.14.131:48796 deadline: 1689705308420, exception=org.apache.hadoop.hbase.constraint.ConstraintException: RSGroup Group_foo is referenced by namespace: Group_foo 2023-07-18 18:15:08,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$16(3053): Client=jenkins//172.31.14.131 modify {NAME => 'Group_foo', hbase.rsgroup.name => 'Group_foo'} 2023-07-18 18:15:08,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:MODIFY_NAMESPACE_PREPARE; ModifyNamespaceProcedure, namespace=Group_foo 2023-07-18 18:15:08,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:15:08,440 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/Group_foo 2023-07-18 18:15:08,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; ModifyNamespaceProcedure, namespace=Group_foo in 13 msec 2023-07-18 18:15:08,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:15:08,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup Group_anotherGroup 2023-07-18 18:15:08,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_anotherGroup 2023-07-18 18:15:08,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_foo 2023-07-18 18:15:08,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 8 2023-07-18 18:15:08,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.HMaster$17(3086): Client=jenkins//172.31.14.131 delete Group_foo 2023-07-18 18:15:08,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=Group_foo 2023-07-18 18:15:08,563 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=22, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=Group_foo 2023-07-18 18:15:08,565 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=22, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=Group_foo 2023-07-18 18:15:08,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2023-07-18 18:15:08,566 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=22, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=Group_foo 2023-07-18 18:15:08,567 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/Group_foo 2023-07-18 18:15:08,567 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:15:08,568 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=22, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=Group_foo 2023-07-18 18:15:08,570 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=22, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=Group_foo 2023-07-18 18:15:08,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; DeleteNamespaceProcedure, namespace=Group_foo in 14 msec 2023-07-18 18:15:08,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2023-07-18 18:15:08,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup Group_foo 2023-07-18 18:15:08,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/Group_anotherGroup 2023-07-18 18:15:08,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 7 2023-07-18 18:15:08,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Region server group foo does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint.preCreateNamespace(RSGroupAdminEndpoint.java:591) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$1.call(MasterCoprocessorHost.java:222) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$1.call(MasterCoprocessorHost.java:219) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.master.MasterCoprocessorHost.preCreateNamespace(MasterCoprocessorHost.java:219) at org.apache.hadoop.hbase.master.HMaster$15.run(HMaster.java:3010) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.createNamespace(HMaster.java:3007) at org.apache.hadoop.hbase.master.MasterRpcServices.createNamespace(MasterRpcServices.java:684) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 290 service: MasterService methodName: CreateNamespace size: 70 connection: 172.31.14.131:48796 deadline: 1689704168677, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Region server group foo does not exist. 2023-07-18 18:15:08,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:08,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:08,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:08,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:08,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:08,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup Group_anotherGroup 2023-07-18 18:15:08,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 5 2023-07-18 18:15:08,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(231): Client=jenkins//172.31.14.131 move tables [] to rsgroup default 2023-07-18 18:15:08,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminServer(448): moveTables() passed an empty set. Ignoring. 2023-07-18 18:15:08,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveTables 2023-07-18 18:15:08,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [] to rsgroup default 2023-07-18 18:15:08,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.MoveServers 2023-07-18 18:15:08,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(272): Client=jenkins//172.31.14.131 remove rsgroup master 2023-07-18 18:15:08,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 3 2023-07-18 18:15:08,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.RemoveRSGroup 2023-07-18 18:15:08,695 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase(152): Restoring servers: 0 2023-07-18 18:15:08,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(252): Client=jenkins//172.31.14.131 add rsgroup master 2023-07-18 18:15:08,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/default 2023-07-18 18:15:08,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(662): Updating znode: /hbase/rsgroup/master 2023-07-18 18:15:08,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupInfoManagerImpl(668): Writing ZK GroupInfo count: 4 2023-07-18 18:15:08,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.AddRSGroup 2023-07-18 18:15:08,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(206): Client=jenkins//172.31.14.131 move servers [jenkins-hbase4.apache.org:44147] to rsgroup master 2023-07-18 18:15:08,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 18:15:08,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] ipc.CallRunner(144): callId: 320 service: MasterService methodName: ExecMasterService size: 119 connection: 172.31.14.131:48796 deadline: 1689705308704, exception=org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. 2023-07-18 18:15:08,705 WARN [Listener at localhost/41213] rsgroup.TestRSGroupsBase(163): Got this on setup, FYI org.apache.hadoop.hbase.constraint.ConstraintException: org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor56.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:364) at org.apache.hadoop.hbase.client.MasterCallable.call(MasterCallable.java:101) at org.apache.hadoop.hbase.client.HBaseAdmin$74.callExecService(HBaseAdmin.java:2985) at org.apache.hadoop.hbase.client.SyncCoprocessorRpcChannel.callBlockingMethod(SyncCoprocessorRpcChannel.java:62) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService$BlockingStub.moveServers(RSGroupAdminProtos.java:16658) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminClient.moveServers(RSGroupAdminClient.java:108) at org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient.moveServers(VerifyingRSGroupAdminClient.java:77) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase.tearDownAfterMethod(TestRSGroupsBase.java:161) at org.apache.hadoop.hbase.rsgroup.TestRSGroupsAdmin1.afterMethod(TestRSGroupsAdmin1.java:91) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.constraint.ConstraintException): org.apache.hadoop.hbase.constraint.ConstraintException: Server jenkins-hbase4.apache.org:44147 is either offline or it does not exist. at org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer.moveServers(RSGroupAdminServer.java:408) at org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl.moveServers(RSGroupAdminEndpoint.java:213) at org.apache.hadoop.hbase.protobuf.generated.RSGroupAdminProtos$RSGroupAdminService.callMethod(RSGroupAdminProtos.java:16193) at org.apache.hadoop.hbase.master.MasterRpcServices.execMasterService(MasterRpcServices.java:900) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-18 18:15:08,706 INFO [Listener at localhost/41213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:15:08,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(316): Client=jenkins//172.31.14.131 list rsgroup 2023-07-18 18:15:08,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.ListRSGroupInfos 2023-07-18 18:15:08,707 INFO [Listener at localhost/41213] rsgroup.TestRSGroupsBase$2(169): Waiting for cleanup to finish [Name:default, Servers:[jenkins-hbase4.apache.org:35809, jenkins-hbase4.apache.org:40393, jenkins-hbase4.apache.org:46305, jenkins-hbase4.apache.org:46387], Tables:[hbase:meta, hbase:namespace, hbase:rsgroup], Configurations:{}, Name:master, Servers:[], Tables:[], Configurations:{}] 2023-07-18 18:15:08,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] rsgroup.RSGroupAdminEndpoint$RSGroupAdminServiceImpl(165): Client=jenkins//172.31.14.131 initiates rsgroup info retrieval, group=default 2023-07-18 18:15:08,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44147] master.MasterRpcServices(912): User jenkins (auth:SIMPLE) (remote address: /172.31.14.131) master service request for RSGroupAdminService.GetRSGroupInfo 2023-07-18 18:15:08,724 INFO [Listener at localhost/41213] hbase.ResourceChecker(175): after: rsgroup.TestRSGroupsAdmin1#testNamespaceConstraint Thread=570 (was 570), OpenFileDescriptor=842 (was 842), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=428 (was 428), ProcessCount=171 (was 173), AvailableMemoryMB=4867 (was 2728) - AvailableMemoryMB LEAK? - 2023-07-18 18:15:08,724 WARN [Listener at localhost/41213] hbase.ResourceChecker(130): Thread=570 is superior to 500 2023-07-18 18:15:08,724 INFO [Listener at localhost/41213] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 18:15:08,724 INFO [Listener at localhost/41213] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 18:15:08,724 DEBUG [Listener at localhost/41213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4875d50c to 127.0.0.1:57697 2023-07-18 18:15:08,725 DEBUG [Listener at localhost/41213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,725 DEBUG [Listener at localhost/41213] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 18:15:08,725 DEBUG [Listener at localhost/41213] util.JVMClusterUtil(257): Found active master hash=1526444637, stopped=false 2023-07-18 18:15:08,725 DEBUG [Listener at localhost/41213] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.rsgroup.RSGroupAdminEndpoint 2023-07-18 18:15:08,725 DEBUG [Listener at localhost/41213] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase$CPMasterObserver 2023-07-18 18:15:08,725 INFO [Listener at localhost/41213] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:08,726 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:08,726 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:08,727 INFO [Listener at localhost/41213] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 18:15:08,727 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:08,727 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:08,726 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:08,726 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:15:08,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:08,727 DEBUG [Listener at localhost/41213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29eac85c to 127.0.0.1:57697 2023-07-18 18:15:08,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:08,727 DEBUG [Listener at localhost/41213] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:08,728 INFO [Listener at localhost/41213] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35809,1689704104324' ***** 2023-07-18 18:15:08,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:08,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:15:08,728 INFO [Listener at localhost/41213] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:15:08,728 INFO [Listener at localhost/41213] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46305,1689704104476' ***** 2023-07-18 18:15:08,728 INFO [Listener at localhost/41213] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:15:08,728 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:08,728 INFO [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:08,728 INFO [Listener at localhost/41213] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40393,1689704104623' ***** 2023-07-18 18:15:08,729 INFO [Listener at localhost/41213] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:15:08,730 INFO [Listener at localhost/41213] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46387,1689704106530' ***** 2023-07-18 18:15:08,730 INFO [Listener at localhost/41213] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:15:08,732 INFO [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:08,730 INFO [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:08,738 INFO [RS:1;jenkins-hbase4:46305] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@1f4b851f{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:08,739 INFO [RS:0;jenkins-hbase4:35809] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@5d16009b{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:08,739 INFO [RS:3;jenkins-hbase4:46387] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@3e8cf2fc{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:08,739 INFO [RS:1;jenkins-hbase4:46305] server.AbstractConnector(383): Stopped ServerConnector@6d04da20{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:08,739 INFO [RS:2;jenkins-hbase4:40393] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@72c3dca2{regionserver,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/regionserver} 2023-07-18 18:15:08,739 INFO [RS:0;jenkins-hbase4:35809] server.AbstractConnector(383): Stopped ServerConnector@6ba4dce4{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:08,739 INFO [RS:1;jenkins-hbase4:46305] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:08,739 INFO [RS:0;jenkins-hbase4:35809] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:08,739 INFO [RS:3;jenkins-hbase4:46387] server.AbstractConnector(383): Stopped ServerConnector@134f4aae{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:08,740 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:15:08,741 INFO [RS:0;jenkins-hbase4:35809] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@295166fc{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:08,740 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:08,739 INFO [RS:2;jenkins-hbase4:40393] server.AbstractConnector(383): Stopped ServerConnector@72f6fde0{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:08,742 INFO [RS:0;jenkins-hbase4:35809] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@75e5d650{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:08,741 INFO [RS:1;jenkins-hbase4:46305] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@42cd0009{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:08,741 INFO [RS:3;jenkins-hbase4:46387] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:08,743 INFO [RS:1;jenkins-hbase4:46305] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@288689f8{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:08,742 INFO [RS:2;jenkins-hbase4:40393] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:08,743 INFO [RS:0;jenkins-hbase4:35809] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:15:08,744 INFO [RS:2;jenkins-hbase4:40393] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@736db136{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:08,743 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-18 18:15:08,745 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-18 18:15:08,743 INFO [RS:3;jenkins-hbase4:46387] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2d37a2b0{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:08,745 INFO [RS:2;jenkins-hbase4:40393] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@51b99b82{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:08,746 INFO [RS:1;jenkins-hbase4:46305] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:15:08,746 INFO [RS:1;jenkins-hbase4:46305] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:15:08,746 INFO [RS:1;jenkins-hbase4:46305] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:15:08,746 INFO [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:08,746 DEBUG [RS:1;jenkins-hbase4:46305] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77bee678 to 127.0.0.1:57697 2023-07-18 18:15:08,747 DEBUG [RS:1;jenkins-hbase4:46305] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,747 INFO [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46305,1689704104476; all regions closed. 2023-07-18 18:15:08,747 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:15:08,745 INFO [RS:0;jenkins-hbase4:35809] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:15:08,744 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:15:08,747 INFO [RS:0;jenkins-hbase4:35809] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:15:08,747 INFO [RS:2;jenkins-hbase4:40393] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:15:08,746 INFO [RS:3;jenkins-hbase4:46387] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@7d3c5a39{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:08,747 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(3305): Received CLOSE for 93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:08,747 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:15:08,748 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(3305): Received CLOSE for 705cd38dcabb731d02b7bdaa205f3177 2023-07-18 18:15:08,748 INFO [RS:2;jenkins-hbase4:40393] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:15:08,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 93db80e00adf8c41f3e1975699c1a490, disabling compactions & flushes 2023-07-18 18:15:08,748 INFO [RS:3;jenkins-hbase4:46387] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:15:08,748 INFO [RS:3;jenkins-hbase4:46387] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:15:08,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:08,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:08,748 INFO [RS:2;jenkins-hbase4:40393] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:15:08,748 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:08,748 INFO [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:08,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. after waiting 0 ms 2023-07-18 18:15:08,748 INFO [RS:3;jenkins-hbase4:46387] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:15:08,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:08,749 DEBUG [RS:2;jenkins-hbase4:40393] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x049601de to 127.0.0.1:57697 2023-07-18 18:15:08,748 DEBUG [RS:0;jenkins-hbase4:35809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b126027 to 127.0.0.1:57697 2023-07-18 18:15:08,749 DEBUG [RS:0;jenkins-hbase4:35809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,749 INFO [RS:0;jenkins-hbase4:35809] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:15:08,749 INFO [RS:0;jenkins-hbase4:35809] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:15:08,749 INFO [RS:0;jenkins-hbase4:35809] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:15:08,749 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 18:15:08,749 DEBUG [RS:2;jenkins-hbase4:40393] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 93db80e00adf8c41f3e1975699c1a490 1/1 column families, dataSize=267 B heapSize=904 B 2023-07-18 18:15:08,749 INFO [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:08,749 INFO [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40393,1689704104623; all regions closed. 2023-07-18 18:15:08,749 DEBUG [RS:3;jenkins-hbase4:46387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f0c6c09 to 127.0.0.1:57697 2023-07-18 18:15:08,749 DEBUG [RS:3;jenkins-hbase4:46387] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,749 INFO [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46387,1689704106530; all regions closed. 2023-07-18 18:15:08,750 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-18 18:15:08,750 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1478): Online Regions={93db80e00adf8c41f3e1975699c1a490=hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490., 705cd38dcabb731d02b7bdaa205f3177=hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177., 1588230740=hbase:meta,,1.1588230740} 2023-07-18 18:15:08,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:15:08,751 DEBUG [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1504): Waiting on 1588230740, 705cd38dcabb731d02b7bdaa205f3177, 93db80e00adf8c41f3e1975699c1a490 2023-07-18 18:15:08,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:15:08,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:15:08,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:15:08,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:15:08,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=4.51 KB heapSize=8.81 KB 2023-07-18 18:15:08,758 DEBUG [RS:1;jenkins-hbase4:46305] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs 2023-07-18 18:15:08,758 INFO [RS:1;jenkins-hbase4:46305] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46305%2C1689704104476:(num 1689704105208) 2023-07-18 18:15:08,758 DEBUG [RS:1;jenkins-hbase4:46305] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,758 INFO [RS:1;jenkins-hbase4:46305] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:08,759 INFO [RS:1;jenkins-hbase4:46305] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 18:15:08,759 INFO [RS:1;jenkins-hbase4:46305] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:15:08,759 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:08,759 INFO [RS:1;jenkins-hbase4:46305] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:15:08,759 INFO [RS:1;jenkins-hbase4:46305] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:15:08,760 INFO [RS:1;jenkins-hbase4:46305] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46305 2023-07-18 18:15:08,762 DEBUG [RS:2;jenkins-hbase4:40393] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs 2023-07-18 18:15:08,762 INFO [RS:2;jenkins-hbase4:40393] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40393%2C1689704104623:(num 1689704105205) 2023-07-18 18:15:08,762 DEBUG [RS:2;jenkins-hbase4:40393] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,762 INFO [RS:2;jenkins-hbase4:40393] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:08,762 INFO [RS:2;jenkins-hbase4:40393] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:15:08,762 INFO [RS:2;jenkins-hbase4:40393] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:15:08,762 INFO [RS:2;jenkins-hbase4:40393] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:15:08,762 INFO [RS:2;jenkins-hbase4:40393] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:15:08,762 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:08,762 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:08,762 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:08,762 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:08,762 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:08,763 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:08,763 INFO [RS:2;jenkins-hbase4:40393] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40393 2023-07-18 18:15:08,763 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:08,763 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:08,764 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46305,1689704104476 2023-07-18 18:15:08,764 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:08,764 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46305,1689704104476] 2023-07-18 18:15:08,764 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46305,1689704104476; numProcessing=1 2023-07-18 18:15:08,765 DEBUG [RS:3;jenkins-hbase4:46387] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs 2023-07-18 18:15:08,765 INFO [RS:3;jenkins-hbase4:46387] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46387%2C1689704106530:(num 1689704106871) 2023-07-18 18:15:08,765 DEBUG [RS:3;jenkins-hbase4:46387] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:08,765 INFO [RS:3;jenkins-hbase4:46387] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:08,766 INFO [RS:3;jenkins-hbase4:46387] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:15:08,766 INFO [RS:3;jenkins-hbase4:46387] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:15:08,766 INFO [RS:3;jenkins-hbase4:46387] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:15:08,766 INFO [RS:3;jenkins-hbase4:46387] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:15:08,766 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:08,766 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:08,766 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:08,767 INFO [RS:3;jenkins-hbase4:46387] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46387 2023-07-18 18:15:08,767 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:08,767 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46305,1689704104476 already deleted, retry=false 2023-07-18 18:15:08,767 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:08,767 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46305,1689704104476 expired; onlineServers=3 2023-07-18 18:15:08,768 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40393,1689704104623 2023-07-18 18:15:08,769 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:08,769 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:08,769 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46387,1689704106530 2023-07-18 18:15:08,769 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40393,1689704104623] 2023-07-18 18:15:08,769 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40393,1689704104623; numProcessing=2 2023-07-18 18:15:08,771 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:08,771 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:08,773 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40393,1689704104623 already deleted, retry=false 2023-07-18 18:15:08,773 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40393,1689704104623 expired; onlineServers=2 2023-07-18 18:15:08,773 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46387,1689704106530] 2023-07-18 18:15:08,773 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46387,1689704106530; numProcessing=3 2023-07-18 18:15:08,775 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46387,1689704106530 already deleted, retry=false 2023-07-18 18:15:08,775 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46387,1689704106530 expired; onlineServers=1 2023-07-18 18:15:08,777 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:08,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=267 B at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490/.tmp/info/1e2593dbebb74597bfc10ee81943fec2 2023-07-18 18:15:08,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=4.01 KB at sequenceid=26 (bloomFilter=false), to=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/.tmp/info/24c999d20b6545feb97143dbfc8614b8 2023-07-18 18:15:08,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e2593dbebb74597bfc10ee81943fec2 2023-07-18 18:15:08,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490/.tmp/info/1e2593dbebb74597bfc10ee81943fec2 as hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490/info/1e2593dbebb74597bfc10ee81943fec2 2023-07-18 18:15:08,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24c999d20b6545feb97143dbfc8614b8 2023-07-18 18:15:08,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e2593dbebb74597bfc10ee81943fec2 2023-07-18 18:15:08,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490/info/1e2593dbebb74597bfc10ee81943fec2, entries=3, sequenceid=9, filesize=5.0 K 2023-07-18 18:15:08,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~267 B/267, heapSize ~888 B/888, currentSize=0 B/0 for 93db80e00adf8c41f3e1975699c1a490 in 45ms, sequenceid=9, compaction requested=false 2023-07-18 18:15:08,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/namespace/93db80e00adf8c41f3e1975699c1a490/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-07-18 18:15:08,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:08,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 93db80e00adf8c41f3e1975699c1a490: 2023-07-18 18:15:08,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689704105822.93db80e00adf8c41f3e1975699c1a490. 2023-07-18 18:15:08,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 705cd38dcabb731d02b7bdaa205f3177, disabling compactions & flushes 2023-07-18 18:15:08,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:08,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:08,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. after waiting 0 ms 2023-07-18 18:15:08,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:08,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 705cd38dcabb731d02b7bdaa205f3177 1/1 column families, dataSize=6.43 KB heapSize=10.63 KB 2023-07-18 18:15:08,808 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=82 B at sequenceid=26 (bloomFilter=false), to=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/.tmp/rep_barrier/4d8fa05fede846b9b9e57d0525fcd309 2023-07-18 18:15:08,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d8fa05fede846b9b9e57d0525fcd309 2023-07-18 18:15:08,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=6.43 KB at sequenceid=29 (bloomFilter=true), to=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177/.tmp/m/7e3007b6319949058e6731c13231bedd 2023-07-18 18:15:08,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e3007b6319949058e6731c13231bedd 2023-07-18 18:15:08,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177/.tmp/m/7e3007b6319949058e6731c13231bedd as hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177/m/7e3007b6319949058e6731c13231bedd 2023-07-18 18:15:08,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e3007b6319949058e6731c13231bedd 2023-07-18 18:15:08,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177/m/7e3007b6319949058e6731c13231bedd, entries=12, sequenceid=29, filesize=5.4 K 2023-07-18 18:15:08,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~6.43 KB/6586, heapSize ~10.61 KB/10864, currentSize=0 B/0 for 705cd38dcabb731d02b7bdaa205f3177 in 33ms, sequenceid=29, compaction requested=false 2023-07-18 18:15:08,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=26 (bloomFilter=false), to=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/.tmp/table/945115f0c5a54a1d9e5c308330ee1d6c 2023-07-18 18:15:08,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/rsgroup/705cd38dcabb731d02b7bdaa205f3177/recovered.edits/32.seqid, newMaxSeqId=32, maxSeqId=1 2023-07-18 18:15:08,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:15:08,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:08,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 705cd38dcabb731d02b7bdaa205f3177: 2023-07-18 18:15:08,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:rsgroup,,1689704106068.705cd38dcabb731d02b7bdaa205f3177. 2023-07-18 18:15:08,852 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 945115f0c5a54a1d9e5c308330ee1d6c 2023-07-18 18:15:08,852 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/.tmp/info/24c999d20b6545feb97143dbfc8614b8 as hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/info/24c999d20b6545feb97143dbfc8614b8 2023-07-18 18:15:08,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24c999d20b6545feb97143dbfc8614b8 2023-07-18 18:15:08,857 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/info/24c999d20b6545feb97143dbfc8614b8, entries=22, sequenceid=26, filesize=7.3 K 2023-07-18 18:15:08,858 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/.tmp/rep_barrier/4d8fa05fede846b9b9e57d0525fcd309 as hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/rep_barrier/4d8fa05fede846b9b9e57d0525fcd309 2023-07-18 18:15:08,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4d8fa05fede846b9b9e57d0525fcd309 2023-07-18 18:15:08,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/rep_barrier/4d8fa05fede846b9b9e57d0525fcd309, entries=1, sequenceid=26, filesize=4.9 K 2023-07-18 18:15:08,864 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/.tmp/table/945115f0c5a54a1d9e5c308330ee1d6c as hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/table/945115f0c5a54a1d9e5c308330ee1d6c 2023-07-18 18:15:08,873 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 945115f0c5a54a1d9e5c308330ee1d6c 2023-07-18 18:15:08,874 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/table/945115f0c5a54a1d9e5c308330ee1d6c, entries=6, sequenceid=26, filesize=5.1 K 2023-07-18 18:15:08,875 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~4.51 KB/4614, heapSize ~8.77 KB/8976, currentSize=0 B/0 for 1588230740 in 124ms, sequenceid=26, compaction requested=false 2023-07-18 18:15:08,883 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/data/hbase/meta/1588230740/recovered.edits/29.seqid, newMaxSeqId=29, maxSeqId=1 2023-07-18 18:15:08,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:15:08,884 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:15:08,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:15:08,884 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 18:15:08,926 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:08,926 INFO [RS:3;jenkins-hbase4:46387] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46387,1689704106530; zookeeper connection closed. 2023-07-18 18:15:08,926 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46387-0x10179a503c8000b, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:08,926 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@33cd0dba] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@33cd0dba 2023-07-18 18:15:08,951 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35809,1689704104324; all regions closed. 2023-07-18 18:15:08,956 DEBUG [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs 2023-07-18 18:15:08,956 INFO [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35809%2C1689704104324.meta:.meta(num 1689704105767) 2023-07-18 18:15:08,959 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/WALs/jenkins-hbase4.apache.org,35809,1689704104324/jenkins-hbase4.apache.org%2C35809%2C1689704104324.1689704105205 not finished, retry = 0 2023-07-18 18:15:09,026 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:09,026 INFO [RS:2;jenkins-hbase4:40393] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40393,1689704104623; zookeeper connection closed. 2023-07-18 18:15:09,027 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:40393-0x10179a503c80003, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:09,027 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6a6f92c1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6a6f92c1 2023-07-18 18:15:09,062 DEBUG [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/oldWALs 2023-07-18 18:15:09,062 INFO [RS:0;jenkins-hbase4:35809] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35809%2C1689704104324:(num 1689704105205) 2023-07-18 18:15:09,062 DEBUG [RS:0;jenkins-hbase4:35809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:09,062 INFO [RS:0;jenkins-hbase4:35809] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:15:09,063 INFO [RS:0;jenkins-hbase4:35809] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:15:09,063 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:09,064 INFO [RS:0;jenkins-hbase4:35809] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35809 2023-07-18 18:15:09,065 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35809,1689704104324 2023-07-18 18:15:09,065 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:15:09,068 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35809,1689704104324] 2023-07-18 18:15:09,068 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35809,1689704104324; numProcessing=4 2023-07-18 18:15:09,069 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35809,1689704104324 already deleted, retry=false 2023-07-18 18:15:09,069 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35809,1689704104324 expired; onlineServers=0 2023-07-18 18:15:09,069 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44147,1689704104150' ***** 2023-07-18 18:15:09,069 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 18:15:09,070 DEBUG [M:0;jenkins-hbase4:44147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ec42dda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:15:09,070 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegionServer(1109): Stopping infoServer 2023-07-18 18:15:09,072 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 18:15:09,072 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:15:09,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:15:09,073 INFO [M:0;jenkins-hbase4:44147] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.w.WebAppContext@21d993e9{master,/,null,STOPPED}{jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/master} 2023-07-18 18:15:09,073 INFO [M:0;jenkins-hbase4:44147] server.AbstractConnector(383): Stopped ServerConnector@50e3498a{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:09,073 INFO [M:0;jenkins-hbase4:44147] session.HouseKeeper(149): node0 Stopped scavenging 2023-07-18 18:15:09,074 INFO [M:0;jenkins-hbase4:44147] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@2ce8454f{static,/static,jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar!/hbase-webapps/static,STOPPED} 2023-07-18 18:15:09,074 INFO [M:0;jenkins-hbase4:44147] handler.ContextHandler(1159): Stopped o.a.h.t.o.e.j.s.ServletContextHandler@558dcba1{logs,/logs,file:///home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/hadoop.log.dir/,STOPPED} 2023-07-18 18:15:09,075 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44147,1689704104150 2023-07-18 18:15:09,075 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44147,1689704104150; all regions closed. 2023-07-18 18:15:09,075 DEBUG [M:0;jenkins-hbase4:44147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:15:09,075 INFO [M:0;jenkins-hbase4:44147] master.HMaster(1491): Stopping master jetty server 2023-07-18 18:15:09,076 INFO [M:0;jenkins-hbase4:44147] server.AbstractConnector(383): Stopped ServerConnector@780ec191{HTTP/1.1, (http/1.1)}{0.0.0.0:0} 2023-07-18 18:15:09,076 DEBUG [M:0;jenkins-hbase4:44147] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 18:15:09,076 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 18:15:09,076 DEBUG [M:0;jenkins-hbase4:44147] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 18:15:09,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704104975] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689704104975,5,FailOnTimeoutGroup] 2023-07-18 18:15:09,076 INFO [M:0;jenkins-hbase4:44147] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 18:15:09,076 INFO [M:0;jenkins-hbase4:44147] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 18:15:09,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704104975] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689704104975,5,FailOnTimeoutGroup] 2023-07-18 18:15:09,076 INFO [M:0;jenkins-hbase4:44147] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 18:15:09,076 DEBUG [M:0;jenkins-hbase4:44147] master.HMaster(1512): Stopping service threads 2023-07-18 18:15:09,077 INFO [M:0;jenkins-hbase4:44147] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 18:15:09,077 ERROR [M:0;jenkins-hbase4:44147] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-18 18:15:09,077 INFO [M:0;jenkins-hbase4:44147] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 18:15:09,077 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 18:15:09,077 DEBUG [M:0;jenkins-hbase4:44147] zookeeper.ZKUtil(398): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 18:15:09,077 WARN [M:0;jenkins-hbase4:44147] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 18:15:09,077 INFO [M:0;jenkins-hbase4:44147] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 18:15:09,077 INFO [M:0;jenkins-hbase4:44147] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 18:15:09,077 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:15:09,078 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:09,078 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:09,078 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:15:09,078 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:09,078 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=76.18 KB heapSize=90.63 KB 2023-07-18 18:15:09,089 INFO [M:0;jenkins-hbase4:44147] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=76.18 KB at sequenceid=175 (bloomFilter=true), to=hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a71fb1c59fce4189b08ffcdd7bc14109 2023-07-18 18:15:09,094 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a71fb1c59fce4189b08ffcdd7bc14109 as hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a71fb1c59fce4189b08ffcdd7bc14109 2023-07-18 18:15:09,099 INFO [M:0;jenkins-hbase4:44147] regionserver.HStore(1080): Added hdfs://localhost:32911/user/jenkins/test-data/8268c5be-f6ad-e484-5a75-9ce32c088e4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a71fb1c59fce4189b08ffcdd7bc14109, entries=22, sequenceid=175, filesize=11.1 K 2023-07-18 18:15:09,099 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegion(2948): Finished flush of dataSize ~76.18 KB/78007, heapSize ~90.62 KB/92792, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=175, compaction requested=false 2023-07-18 18:15:09,101 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:15:09,101 DEBUG [M:0;jenkins-hbase4:44147] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:15:09,104 INFO [M:0;jenkins-hbase4:44147] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 18:15:09,104 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:15:09,105 INFO [M:0;jenkins-hbase4:44147] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44147 2023-07-18 18:15:09,106 DEBUG [M:0;jenkins-hbase4:44147] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44147,1689704104150 already deleted, retry=false 2023-07-18 18:15:09,127 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:09,127 INFO [RS:1;jenkins-hbase4:46305] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46305,1689704104476; zookeeper connection closed. 2023-07-18 18:15:09,127 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:46305-0x10179a503c80002, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:09,127 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@28461c70] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@28461c70 2023-07-18 18:15:09,728 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:09,728 INFO [M:0;jenkins-hbase4:44147] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44147,1689704104150; zookeeper connection closed. 2023-07-18 18:15:09,729 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): master:44147-0x10179a503c80000, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:09,829 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:09,829 INFO [RS:0;jenkins-hbase4:35809] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35809,1689704104324; zookeeper connection closed. 2023-07-18 18:15:09,829 DEBUG [Listener at localhost/41213-EventThread] zookeeper.ZKWatcher(600): regionserver:35809-0x10179a503c80001, quorum=127.0.0.1:57697, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:15:09,829 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3274f373] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3274f373 2023-07-18 18:15:09,829 INFO [Listener at localhost/41213] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 4 regionserver(s) complete 2023-07-18 18:15:09,830 WARN [Listener at localhost/41213] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:15:09,833 INFO [Listener at localhost/41213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:15:09,936 WARN [BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:15:09,936 WARN [BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-534196876-172.31.14.131-1689704103357 (Datanode Uuid 61bad10a-1a52-4568-8703-783fc478e307) service to localhost/127.0.0.1:32911 2023-07-18 18:15:09,937 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data5/current/BP-534196876-172.31.14.131-1689704103357] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:09,937 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data6/current/BP-534196876-172.31.14.131-1689704103357] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:09,938 WARN [Listener at localhost/41213] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:15:09,941 INFO [Listener at localhost/41213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:15:10,045 WARN [BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:15:10,045 WARN [BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-534196876-172.31.14.131-1689704103357 (Datanode Uuid 6b494d8e-b53b-48de-8789-4347bfa4a89e) service to localhost/127.0.0.1:32911 2023-07-18 18:15:10,046 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data3/current/BP-534196876-172.31.14.131-1689704103357] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:10,046 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data4/current/BP-534196876-172.31.14.131-1689704103357] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:10,047 WARN [Listener at localhost/41213] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:15:10,050 INFO [Listener at localhost/41213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:15:10,152 WARN [BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:15:10,152 WARN [BP-534196876-172.31.14.131-1689704103357 heartbeating to localhost/127.0.0.1:32911] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-534196876-172.31.14.131-1689704103357 (Datanode Uuid c1f2a1f8-db22-46a7-b73d-643ce82f03fb) service to localhost/127.0.0.1:32911 2023-07-18 18:15:10,153 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data1/current/BP-534196876-172.31.14.131-1689704103357] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:10,154 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-rsgroup/target/test-data/2abdadb4-23f6-2228-a4a7-8d766ddac159/cluster_e7093904-f68d-5f31-99a2-4e131b72140a/dfs/data/data2/current/BP-534196876-172.31.14.131-1689704103357] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:15:10,164 INFO [Listener at localhost/41213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:15:10,280 INFO [Listener at localhost/41213] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 18:15:10,311 INFO [Listener at localhost/41213] hbase.HBaseTestingUtility(1293): Minicluster is down