2023-07-11 18:47:06,162 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster timeout: 13 mins 2023-07-11 18:47:06,375 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0 2023-07-11 18:47:06,388 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=class org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster$MyMaster, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 18:47:06,388 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d, deleteOnExit=true 2023-07-11 18:47:06,388 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 18:47:06,389 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/test.cache.data in system properties and HBase conf 2023-07-11 18:47:06,389 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 18:47:06,389 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/hadoop.log.dir in system properties and HBase conf 2023-07-11 18:47:06,390 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 18:47:06,390 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 18:47:06,390 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 18:47:06,499 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 18:47:06,914 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 18:47:06,917 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 18:47:06,918 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 18:47:06,918 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 18:47:06,918 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 18:47:06,919 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 18:47:06,919 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 18:47:06,919 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 18:47:06,919 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 18:47:06,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 18:47:06,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/nfs.dump.dir in system properties and HBase conf 2023-07-11 18:47:06,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/java.io.tmpdir in system properties and HBase conf 2023-07-11 18:47:06,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 18:47:06,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 18:47:06,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 18:47:07,384 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 18:47:07,389 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 18:47:07,689 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 18:47:07,839 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 18:47:07,853 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 18:47:07,890 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 18:47:07,952 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/java.io.tmpdir/Jetty_localhost_46099_hdfs____.rtl58o/webapp 2023-07-11 18:47:08,091 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46099 2023-07-11 18:47:08,101 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 18:47:08,101 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 18:47:08,532 WARN [Listener at localhost/33811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 18:47:08,597 WARN [Listener at localhost/33811] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 18:47:08,615 WARN [Listener at localhost/33811] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 18:47:08,620 INFO [Listener at localhost/33811] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 18:47:08,624 INFO [Listener at localhost/33811] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/java.io.tmpdir/Jetty_localhost_38903_datanode____.90mrdu/webapp 2023-07-11 18:47:08,725 INFO [Listener at localhost/33811] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38903 2023-07-11 18:47:09,048 WARN [Listener at localhost/43129] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 18:47:09,058 WARN [Listener at localhost/43129] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 18:47:09,064 WARN [Listener at localhost/43129] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 18:47:09,066 INFO [Listener at localhost/43129] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 18:47:09,071 INFO [Listener at localhost/43129] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/java.io.tmpdir/Jetty_localhost_44891_datanode____rovu0n/webapp 2023-07-11 18:47:09,175 INFO [Listener at localhost/43129] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44891 2023-07-11 18:47:09,183 WARN [Listener at localhost/35935] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 18:47:09,194 WARN [Listener at localhost/35935] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 18:47:09,196 WARN [Listener at localhost/35935] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 18:47:09,198 INFO [Listener at localhost/35935] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 18:47:09,205 INFO [Listener at localhost/35935] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/java.io.tmpdir/Jetty_localhost_44165_datanode____wgis7/webapp 2023-07-11 18:47:09,317 INFO [Listener at localhost/35935] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44165 2023-07-11 18:47:09,325 WARN [Listener at localhost/44535] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 18:47:09,510 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe1472372ca302ced: Processing first storage report for DS-6cb48b31-2aae-40e3-b604-978ba45a3921 from datanode 3a096449-0f61-4377-89b3-70f938da5e7e 2023-07-11 18:47:09,512 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe1472372ca302ced: from storage DS-6cb48b31-2aae-40e3-b604-978ba45a3921 node DatanodeRegistration(127.0.0.1:39985, datanodeUuid=3a096449-0f61-4377-89b3-70f938da5e7e, infoPort=41145, infoSecurePort=0, ipcPort=43129, storageInfo=lv=-57;cid=testClusterID;nsid=1815451492;c=1689101227463), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 18:47:09,512 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d1191c191cdfc9d: Processing first storage report for DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6 from datanode 20c2cda4-3fcf-4c8e-8e4d-6eea3115324d 2023-07-11 18:47:09,512 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d1191c191cdfc9d: from storage DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6 node DatanodeRegistration(127.0.0.1:34695, datanodeUuid=20c2cda4-3fcf-4c8e-8e4d-6eea3115324d, infoPort=39283, infoSecurePort=0, ipcPort=35935, storageInfo=lv=-57;cid=testClusterID;nsid=1815451492;c=1689101227463), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:47:09,512 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x98d24d295d6aaf3c: Processing first storage report for DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6 from datanode 7cc0be33-cc44-404f-8ecd-5eadfc2b4104 2023-07-11 18:47:09,512 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x98d24d295d6aaf3c: from storage DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6 node DatanodeRegistration(127.0.0.1:37275, datanodeUuid=7cc0be33-cc44-404f-8ecd-5eadfc2b4104, infoPort=36017, infoSecurePort=0, ipcPort=44535, storageInfo=lv=-57;cid=testClusterID;nsid=1815451492;c=1689101227463), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:47:09,512 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe1472372ca302ced: Processing first storage report for DS-24f4cabe-73ac-4c69-81d3-d351de5dbab2 from datanode 3a096449-0f61-4377-89b3-70f938da5e7e 2023-07-11 18:47:09,513 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe1472372ca302ced: from storage DS-24f4cabe-73ac-4c69-81d3-d351de5dbab2 node DatanodeRegistration(127.0.0.1:39985, datanodeUuid=3a096449-0f61-4377-89b3-70f938da5e7e, infoPort=41145, infoSecurePort=0, ipcPort=43129, storageInfo=lv=-57;cid=testClusterID;nsid=1815451492;c=1689101227463), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:47:09,513 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2d1191c191cdfc9d: Processing first storage report for DS-860c3342-ca73-450d-81d7-0afe06799a64 from datanode 20c2cda4-3fcf-4c8e-8e4d-6eea3115324d 2023-07-11 18:47:09,513 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2d1191c191cdfc9d: from storage DS-860c3342-ca73-450d-81d7-0afe06799a64 node DatanodeRegistration(127.0.0.1:34695, datanodeUuid=20c2cda4-3fcf-4c8e-8e4d-6eea3115324d, infoPort=39283, infoSecurePort=0, ipcPort=35935, storageInfo=lv=-57;cid=testClusterID;nsid=1815451492;c=1689101227463), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:47:09,513 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x98d24d295d6aaf3c: Processing first storage report for DS-f2749577-512e-4a87-be05-5c4fca899a7b from datanode 7cc0be33-cc44-404f-8ecd-5eadfc2b4104 2023-07-11 18:47:09,513 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x98d24d295d6aaf3c: from storage DS-f2749577-512e-4a87-be05-5c4fca899a7b node DatanodeRegistration(127.0.0.1:37275, datanodeUuid=7cc0be33-cc44-404f-8ecd-5eadfc2b4104, infoPort=36017, infoSecurePort=0, ipcPort=44535, storageInfo=lv=-57;cid=testClusterID;nsid=1815451492;c=1689101227463), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 18:47:09,710 DEBUG [Listener at localhost/44535] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0 2023-07-11 18:47:09,776 INFO [Listener at localhost/44535] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/zookeeper_0, clientPort=62848, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 18:47:09,794 INFO [Listener at localhost/44535] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62848 2023-07-11 18:47:09,805 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:09,808 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:10,468 INFO [Listener at localhost/44535] util.FSUtils(471): Created version file at hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a with version=8 2023-07-11 18:47:10,468 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/hbase-staging 2023-07-11 18:47:10,758 INFO [Listener at localhost/44535] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 18:47:11,204 INFO [Listener at localhost/44535] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:47:11,235 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,236 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,237 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:47:11,237 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,237 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:47:11,378 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:47:11,448 DEBUG [Listener at localhost/44535] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 18:47:11,541 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.2.10:42667 2023-07-11 18:47:11,551 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:11,553 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:11,573 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42667 connecting to ZooKeeper ensemble=127.0.0.1:62848 2023-07-11 18:47:11,613 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:426670x0, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:47:11,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42667-0x10155a8225f0000 connected 2023-07-11 18:47:11,638 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:11,638 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:47:11,642 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:47:11,650 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42667 2023-07-11 18:47:11,650 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42667 2023-07-11 18:47:11,650 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42667 2023-07-11 18:47:11,651 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42667 2023-07-11 18:47:11,651 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42667 2023-07-11 18:47:11,657 INFO [Listener at localhost/44535] master.HMaster(444): hbase.rootdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a, hbase.cluster.distributed=false 2023-07-11 18:47:11,724 INFO [Listener at localhost/44535] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:47:11,724 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,724 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,724 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:47:11,725 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,725 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:47:11,729 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:47:11,732 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.2.10:34803 2023-07-11 18:47:11,734 INFO [Listener at localhost/44535] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 18:47:11,740 DEBUG [Listener at localhost/44535] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 18:47:11,741 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:11,743 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:11,745 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34803 connecting to ZooKeeper ensemble=127.0.0.1:62848 2023-07-11 18:47:11,750 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:348030x0, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:47:11,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34803-0x10155a8225f0001 connected 2023-07-11 18:47:11,751 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:11,752 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:47:11,753 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:47:11,754 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34803 2023-07-11 18:47:11,754 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34803 2023-07-11 18:47:11,755 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34803 2023-07-11 18:47:11,755 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34803 2023-07-11 18:47:11,755 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34803 2023-07-11 18:47:11,768 INFO [Listener at localhost/44535] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:47:11,768 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,768 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,769 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:47:11,769 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,769 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:47:11,769 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:47:11,772 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.2.10:41081 2023-07-11 18:47:11,772 INFO [Listener at localhost/44535] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 18:47:11,774 DEBUG [Listener at localhost/44535] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 18:47:11,775 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:11,777 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:11,779 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41081 connecting to ZooKeeper ensemble=127.0.0.1:62848 2023-07-11 18:47:11,783 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:410810x0, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:47:11,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41081-0x10155a8225f0002 connected 2023-07-11 18:47:11,784 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:11,785 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:47:11,785 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:47:11,786 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41081 2023-07-11 18:47:11,786 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41081 2023-07-11 18:47:11,786 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41081 2023-07-11 18:47:11,787 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41081 2023-07-11 18:47:11,787 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41081 2023-07-11 18:47:11,800 INFO [Listener at localhost/44535] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:47:11,800 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,800 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,801 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:47:11,801 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:11,801 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:47:11,801 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:47:11,802 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.2.10:40505 2023-07-11 18:47:11,802 INFO [Listener at localhost/44535] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 18:47:11,803 DEBUG [Listener at localhost/44535] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 18:47:11,804 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:11,806 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:11,807 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40505 connecting to ZooKeeper ensemble=127.0.0.1:62848 2023-07-11 18:47:11,810 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:405050x0, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:47:11,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40505-0x10155a8225f0003 connected 2023-07-11 18:47:11,811 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:11,812 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:47:11,813 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:47:11,813 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40505 2023-07-11 18:47:11,814 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40505 2023-07-11 18:47:11,814 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40505 2023-07-11 18:47:11,814 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40505 2023-07-11 18:47:11,815 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40505 2023-07-11 18:47:11,817 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:11,826 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 18:47:11,827 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:11,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:11,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:11,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:11,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:11,848 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:11,848 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:47:11,850 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,42667,1689101230598 from backup master directory 2023-07-11 18:47:11,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:47:11,854 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:11,854 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 18:47:11,855 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:47:11,855 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:11,858 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 18:47:11,860 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 18:47:11,948 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/hbase.id with ID: 48047c0c-16f7-44b9-ae0d-0731457ba822 2023-07-11 18:47:11,990 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:12,004 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:12,054 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6cc00985 to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:12,087 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@220e56bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:12,111 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:12,112 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 18:47:12,129 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 18:47:12,129 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 18:47:12,131 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:12,135 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:12,136 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:47:12,170 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store-tmp 2023-07-11 18:47:12,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:12,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 18:47:12,233 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:12,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:12,233 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 18:47:12,234 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:12,234 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:12,234 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:47:12,235 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:12,255 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42667%2C1689101230598, suffix=, logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598, archiveDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/oldWALs, maxLogs=10 2023-07-11 18:47:12,309 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK] 2023-07-11 18:47:12,309 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK] 2023-07-11 18:47:12,309 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK] 2023-07-11 18:47:12,317 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:12,381 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598/jenkins-hbase9.apache.org%2C42667%2C1689101230598.1689101232265 2023-07-11 18:47:12,381 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK], DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK], DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK]] 2023-07-11 18:47:12,382 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:12,382 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:12,385 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:12,386 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:12,442 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:12,450 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 18:47:12,478 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 18:47:12,490 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:12,496 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:12,497 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:12,511 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:12,516 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:12,516 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64625813, jitterRate=-0.03700034320354462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:12,517 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:47:12,518 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 18:47:12,537 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 18:47:12,537 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 18:47:12,539 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:47:12,541 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 18:47:12,572 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 30 msec 2023-07-11 18:47:12,572 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 18:47:12,596 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 18:47:12,602 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 18:47:12,625 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 18:47:12,629 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 18:47:12,630 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 18:47:12,635 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 18:47:12,639 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 18:47:12,642 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:12,644 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 18:47:12,645 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 18:47:12,656 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 18:47:12,661 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 18:47:12,661 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 18:47:12,661 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 18:47:12,661 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 18:47:12,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:12,662 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,42667,1689101230598, sessionid=0x10155a8225f0000, setting cluster-up flag (Was=false) 2023-07-11 18:47:12,681 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:12,688 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 18:47:12,689 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:12,696 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:12,701 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 18:47:12,703 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:12,705 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.hbase-snapshot/.tmp 2023-07-11 18:47:12,718 INFO [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(951): ClusterId : 48047c0c-16f7-44b9-ae0d-0731457ba822 2023-07-11 18:47:12,719 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(951): ClusterId : 48047c0c-16f7-44b9-ae0d-0731457ba822 2023-07-11 18:47:12,718 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(951): ClusterId : 48047c0c-16f7-44b9-ae0d-0731457ba822 2023-07-11 18:47:12,723 DEBUG [RS:1;jenkins-hbase9:41081] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 18:47:12,723 DEBUG [RS:2;jenkins-hbase9:40505] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 18:47:12,723 DEBUG [RS:0;jenkins-hbase9:34803] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 18:47:12,730 DEBUG [RS:1;jenkins-hbase9:41081] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 18:47:12,730 DEBUG [RS:2;jenkins-hbase9:40505] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 18:47:12,730 DEBUG [RS:0;jenkins-hbase9:34803] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 18:47:12,730 DEBUG [RS:2;jenkins-hbase9:40505] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 18:47:12,730 DEBUG [RS:1;jenkins-hbase9:41081] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 18:47:12,730 DEBUG [RS:0;jenkins-hbase9:34803] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 18:47:12,734 DEBUG [RS:1;jenkins-hbase9:41081] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 18:47:12,734 DEBUG [RS:2;jenkins-hbase9:40505] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 18:47:12,734 DEBUG [RS:0;jenkins-hbase9:34803] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 18:47:12,736 DEBUG [RS:2;jenkins-hbase9:40505] zookeeper.ReadOnlyZKClient(139): Connect 0x519ed8c2 to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:12,736 DEBUG [RS:0;jenkins-hbase9:34803] zookeeper.ReadOnlyZKClient(139): Connect 0x5366d7eb to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:12,736 DEBUG [RS:1;jenkins-hbase9:41081] zookeeper.ReadOnlyZKClient(139): Connect 0x0e112f34 to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:12,747 DEBUG [RS:2;jenkins-hbase9:40505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f592c81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:12,748 DEBUG [RS:0;jenkins-hbase9:34803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5da133f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:12,748 DEBUG [RS:1;jenkins-hbase9:41081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d6d086, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:12,748 DEBUG [RS:2;jenkins-hbase9:40505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b66b3b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:47:12,748 DEBUG [RS:0;jenkins-hbase9:34803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599ebc9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:47:12,749 DEBUG [RS:1;jenkins-hbase9:41081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e94444, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:47:12,774 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:41081 2023-07-11 18:47:12,777 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:40505 2023-07-11 18:47:12,778 INFO [RS:1;jenkins-hbase9:41081] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 18:47:12,778 INFO [RS:2;jenkins-hbase9:40505] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 18:47:12,778 INFO [RS:1;jenkins-hbase9:41081] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 18:47:12,778 INFO [RS:2;jenkins-hbase9:40505] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 18:47:12,778 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 18:47:12,778 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 18:47:12,779 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:34803 2023-07-11 18:47:12,779 INFO [RS:0;jenkins-hbase9:34803] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 18:47:12,779 INFO [RS:0;jenkins-hbase9:34803] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 18:47:12,779 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 18:47:12,781 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,42667,1689101230598 with isa=jenkins-hbase9.apache.org/172.31.2.10:41081, startcode=1689101231767 2023-07-11 18:47:12,781 INFO [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,42667,1689101230598 with isa=jenkins-hbase9.apache.org/172.31.2.10:40505, startcode=1689101231800 2023-07-11 18:47:12,781 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,42667,1689101230598 with isa=jenkins-hbase9.apache.org/172.31.2.10:34803, startcode=1689101231723 2023-07-11 18:47:12,799 DEBUG [RS:1;jenkins-hbase9:41081] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:12,799 DEBUG [RS:0;jenkins-hbase9:34803] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:12,799 DEBUG [RS:2;jenkins-hbase9:40505] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:12,846 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 18:47:12,854 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48443, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:12,854 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52405, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:12,854 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54101, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:12,860 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:12,860 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:12,860 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:12,861 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:12,861 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-11 18:47:12,861 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:12,861 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:47:12,861 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:12,862 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42667] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:12,870 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42667] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:12,870 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689101262870 2023-07-11 18:47:12,872 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42667] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:12,874 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 18:47:12,877 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 18:47:12,878 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 18:47:12,883 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:12,886 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 18:47:12,893 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 18:47:12,893 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 18:47:12,894 WARN [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 18:47:12,893 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 18:47:12,893 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(2830): Master is not running yet 2023-07-11 18:47:12,894 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 18:47:12,894 WARN [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 18:47:12,894 WARN [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-11 18:47:12,894 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 18:47:12,894 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 18:47:12,897 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:12,899 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 18:47:12,900 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 18:47:12,900 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 18:47:12,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 18:47:12,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 18:47:12,910 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101232908,5,FailOnTimeoutGroup] 2023-07-11 18:47:12,912 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101232910,5,FailOnTimeoutGroup] 2023-07-11 18:47:12,912 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:12,912 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 18:47:12,914 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:12,914 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:12,936 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:12,937 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:12,937 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a 2023-07-11 18:47:12,960 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:12,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 18:47:12,965 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/info 2023-07-11 18:47:12,966 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 18:47:12,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:12,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 18:47:12,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/rep_barrier 2023-07-11 18:47:12,970 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 18:47:12,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:12,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 18:47:12,973 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/table 2023-07-11 18:47:12,973 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 18:47:12,974 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:12,976 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740 2023-07-11 18:47:12,977 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740 2023-07-11 18:47:12,980 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:47:12,982 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 18:47:12,985 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:12,986 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63244850, jitterRate=-0.05757829546928406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:47:12,986 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 18:47:12,986 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 18:47:12,986 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 18:47:12,986 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 18:47:12,986 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 18:47:12,986 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 18:47:12,988 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 18:47:12,988 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 18:47:12,994 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 18:47:12,994 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 18:47:12,995 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,42667,1689101230598 with isa=jenkins-hbase9.apache.org/172.31.2.10:41081, startcode=1689101231767 2023-07-11 18:47:12,995 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,42667,1689101230598 with isa=jenkins-hbase9.apache.org/172.31.2.10:34803, startcode=1689101231723 2023-07-11 18:47:12,995 INFO [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,42667,1689101230598 with isa=jenkins-hbase9.apache.org/172.31.2.10:40505, startcode=1689101231800 2023-07-11 18:47:13,000 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42667] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 18:47:13,006 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42667] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:13,007 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a 2023-07-11 18:47:13,007 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42667] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:13,007 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33811 2023-07-11 18:47:13,007 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a 2023-07-11 18:47:13,007 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 18:47:13,007 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33811 2023-07-11 18:47:13,008 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 18:47:13,008 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a 2023-07-11 18:47:13,009 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33811 2023-07-11 18:47:13,009 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 18:47:13,016 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:47:13,018 DEBUG [RS:1;jenkins-hbase9:41081] zookeeper.ZKUtil(162): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:13,018 DEBUG [RS:2;jenkins-hbase9:40505] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:13,018 WARN [RS:1;jenkins-hbase9:41081] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:47:13,018 INFO [RS:1;jenkins-hbase9:41081] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:47:13,018 WARN [RS:2;jenkins-hbase9:40505] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:47:13,019 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:13,019 INFO [RS:2;jenkins-hbase9:40505] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:47:13,020 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:13,020 DEBUG [RS:0;jenkins-hbase9:34803] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,020 WARN [RS:0;jenkins-hbase9:34803] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:47:13,020 INFO [RS:0;jenkins-hbase9:34803] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:47:13,020 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,026 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,41081,1689101231767] 2023-07-11 18:47:13,026 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,40505,1689101231800] 2023-07-11 18:47:13,026 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 18:47:13,026 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,34803,1689101231723] 2023-07-11 18:47:13,033 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 18:47:13,038 DEBUG [RS:2;jenkins-hbase9:40505] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:13,038 DEBUG [RS:0;jenkins-hbase9:34803] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:13,038 DEBUG [RS:1;jenkins-hbase9:41081] zookeeper.ZKUtil(162): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:13,039 DEBUG [RS:0;jenkins-hbase9:34803] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:13,039 DEBUG [RS:1;jenkins-hbase9:41081] zookeeper.ZKUtil(162): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:13,039 DEBUG [RS:2;jenkins-hbase9:40505] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:13,040 DEBUG [RS:0;jenkins-hbase9:34803] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,040 DEBUG [RS:1;jenkins-hbase9:41081] zookeeper.ZKUtil(162): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,040 DEBUG [RS:2;jenkins-hbase9:40505] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,050 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 18:47:13,050 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 18:47:13,050 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 18:47:13,060 INFO [RS:1;jenkins-hbase9:41081] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 18:47:13,060 INFO [RS:2;jenkins-hbase9:40505] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 18:47:13,060 INFO [RS:0;jenkins-hbase9:34803] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 18:47:13,082 INFO [RS:1;jenkins-hbase9:41081] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 18:47:13,082 INFO [RS:2;jenkins-hbase9:40505] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 18:47:13,082 INFO [RS:0;jenkins-hbase9:34803] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 18:47:13,086 INFO [RS:2;jenkins-hbase9:40505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:47:13,086 INFO [RS:1;jenkins-hbase9:41081] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:47:13,086 INFO [RS:2;jenkins-hbase9:40505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,086 INFO [RS:1;jenkins-hbase9:41081] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,086 INFO [RS:0;jenkins-hbase9:34803] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:47:13,087 INFO [RS:0;jenkins-hbase9:34803] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,088 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 18:47:13,088 INFO [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 18:47:13,088 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 18:47:13,096 INFO [RS:0;jenkins-hbase9:34803] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,096 INFO [RS:1;jenkins-hbase9:41081] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,096 INFO [RS:2;jenkins-hbase9:40505] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,096 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,096 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:47:13,097 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:47:13,098 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,097 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:2;jenkins-hbase9:40505] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:0;jenkins-hbase9:34803] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,098 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:47:13,099 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,099 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,100 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,100 DEBUG [RS:1;jenkins-hbase9:41081] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:13,101 INFO [RS:0;jenkins-hbase9:34803] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,102 INFO [RS:0;jenkins-hbase9:34803] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,102 INFO [RS:0;jenkins-hbase9:34803] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,102 INFO [RS:2;jenkins-hbase9:40505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,102 INFO [RS:2;jenkins-hbase9:40505] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,102 INFO [RS:2;jenkins-hbase9:40505] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,106 INFO [RS:1;jenkins-hbase9:41081] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,106 INFO [RS:1;jenkins-hbase9:41081] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,106 INFO [RS:1;jenkins-hbase9:41081] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,120 INFO [RS:1;jenkins-hbase9:41081] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 18:47:13,120 INFO [RS:0;jenkins-hbase9:34803] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 18:47:13,120 INFO [RS:2;jenkins-hbase9:40505] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 18:47:13,124 INFO [RS:0;jenkins-hbase9:34803] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34803,1689101231723-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,124 INFO [RS:1;jenkins-hbase9:41081] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,41081,1689101231767-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,124 INFO [RS:2;jenkins-hbase9:40505] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40505,1689101231800-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,145 INFO [RS:0;jenkins-hbase9:34803] regionserver.Replication(203): jenkins-hbase9.apache.org,34803,1689101231723 started 2023-07-11 18:47:13,145 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,34803,1689101231723, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:34803, sessionid=0x10155a8225f0001 2023-07-11 18:47:13,145 DEBUG [RS:0;jenkins-hbase9:34803] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 18:47:13,145 DEBUG [RS:0;jenkins-hbase9:34803] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,145 DEBUG [RS:0;jenkins-hbase9:34803] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,34803,1689101231723' 2023-07-11 18:47:13,145 DEBUG [RS:0;jenkins-hbase9:34803] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:13,146 DEBUG [RS:0;jenkins-hbase9:34803] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:13,146 DEBUG [RS:0;jenkins-hbase9:34803] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 18:47:13,147 DEBUG [RS:0;jenkins-hbase9:34803] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 18:47:13,147 DEBUG [RS:0;jenkins-hbase9:34803] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,147 DEBUG [RS:0;jenkins-hbase9:34803] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,34803,1689101231723' 2023-07-11 18:47:13,147 DEBUG [RS:0;jenkins-hbase9:34803] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 18:47:13,147 DEBUG [RS:0;jenkins-hbase9:34803] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 18:47:13,148 DEBUG [RS:0;jenkins-hbase9:34803] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 18:47:13,148 INFO [RS:0;jenkins-hbase9:34803] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 18:47:13,148 INFO [RS:0;jenkins-hbase9:34803] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 18:47:13,150 INFO [RS:2;jenkins-hbase9:40505] regionserver.Replication(203): jenkins-hbase9.apache.org,40505,1689101231800 started 2023-07-11 18:47:13,150 INFO [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,40505,1689101231800, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:40505, sessionid=0x10155a8225f0003 2023-07-11 18:47:13,150 DEBUG [RS:2;jenkins-hbase9:40505] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 18:47:13,150 DEBUG [RS:2;jenkins-hbase9:40505] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:13,151 DEBUG [RS:2;jenkins-hbase9:40505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40505,1689101231800' 2023-07-11 18:47:13,151 DEBUG [RS:2;jenkins-hbase9:40505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:13,152 DEBUG [RS:2;jenkins-hbase9:40505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:13,152 DEBUG [RS:2;jenkins-hbase9:40505] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 18:47:13,152 DEBUG [RS:2;jenkins-hbase9:40505] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 18:47:13,152 DEBUG [RS:2;jenkins-hbase9:40505] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:13,153 DEBUG [RS:2;jenkins-hbase9:40505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40505,1689101231800' 2023-07-11 18:47:13,153 DEBUG [RS:2;jenkins-hbase9:40505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 18:47:13,154 DEBUG [RS:2;jenkins-hbase9:40505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 18:47:13,154 DEBUG [RS:2;jenkins-hbase9:40505] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 18:47:13,154 INFO [RS:2;jenkins-hbase9:40505] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 18:47:13,155 INFO [RS:2;jenkins-hbase9:40505] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 18:47:13,157 INFO [RS:1;jenkins-hbase9:41081] regionserver.Replication(203): jenkins-hbase9.apache.org,41081,1689101231767 started 2023-07-11 18:47:13,157 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,41081,1689101231767, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:41081, sessionid=0x10155a8225f0002 2023-07-11 18:47:13,157 DEBUG [RS:1;jenkins-hbase9:41081] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 18:47:13,157 DEBUG [RS:1;jenkins-hbase9:41081] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:13,157 DEBUG [RS:1;jenkins-hbase9:41081] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41081,1689101231767' 2023-07-11 18:47:13,157 DEBUG [RS:1;jenkins-hbase9:41081] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:13,158 DEBUG [RS:1;jenkins-hbase9:41081] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:13,158 DEBUG [RS:1;jenkins-hbase9:41081] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 18:47:13,159 DEBUG [RS:1;jenkins-hbase9:41081] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 18:47:13,159 DEBUG [RS:1;jenkins-hbase9:41081] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:13,159 DEBUG [RS:1;jenkins-hbase9:41081] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,41081,1689101231767' 2023-07-11 18:47:13,159 DEBUG [RS:1;jenkins-hbase9:41081] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 18:47:13,159 DEBUG [RS:1;jenkins-hbase9:41081] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 18:47:13,160 DEBUG [RS:1;jenkins-hbase9:41081] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 18:47:13,160 INFO [RS:1;jenkins-hbase9:41081] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 18:47:13,160 INFO [RS:1;jenkins-hbase9:41081] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 18:47:13,186 DEBUG [jenkins-hbase9:42667] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 18:47:13,190 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:13,197 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:13,197 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:13,197 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:13,197 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:13,200 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,34803,1689101231723, state=OPENING 2023-07-11 18:47:13,208 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 18:47:13,211 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:13,212 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 18:47:13,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:13,262 INFO [RS:2;jenkins-hbase9:40505] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40505%2C1689101231800, suffix=, logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,40505,1689101231800, archiveDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs, maxLogs=32 2023-07-11 18:47:13,263 INFO [RS:1;jenkins-hbase9:41081] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C41081%2C1689101231767, suffix=, logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767, archiveDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs, maxLogs=32 2023-07-11 18:47:13,265 INFO [RS:0;jenkins-hbase9:34803] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34803%2C1689101231723, suffix=, logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723, archiveDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs, maxLogs=32 2023-07-11 18:47:13,299 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK] 2023-07-11 18:47:13,299 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK] 2023-07-11 18:47:13,299 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK] 2023-07-11 18:47:13,300 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK] 2023-07-11 18:47:13,300 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK] 2023-07-11 18:47:13,301 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK] 2023-07-11 18:47:13,320 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK] 2023-07-11 18:47:13,320 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK] 2023-07-11 18:47:13,320 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK] 2023-07-11 18:47:13,331 INFO [RS:2;jenkins-hbase9:40505] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,40505,1689101231800/jenkins-hbase9.apache.org%2C40505%2C1689101231800.1689101233268 2023-07-11 18:47:13,331 INFO [RS:0;jenkins-hbase9:34803] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723/jenkins-hbase9.apache.org%2C34803%2C1689101231723.1689101233268 2023-07-11 18:47:13,342 DEBUG [RS:0;jenkins-hbase9:34803] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK], DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK], DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK]] 2023-07-11 18:47:13,350 DEBUG [RS:2;jenkins-hbase9:40505] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK], DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK], DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK]] 2023-07-11 18:47:13,352 INFO [RS:1;jenkins-hbase9:41081] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 2023-07-11 18:47:13,352 DEBUG [RS:1;jenkins-hbase9:41081] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK], DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK], DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK]] 2023-07-11 18:47:13,411 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:13,414 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:13,418 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:47:13,432 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 18:47:13,433 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:47:13,437 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34803%2C1689101231723.meta, suffix=.meta, logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723, archiveDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs, maxLogs=32 2023-07-11 18:47:13,461 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK] 2023-07-11 18:47:13,461 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK] 2023-07-11 18:47:13,467 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK] 2023-07-11 18:47:13,473 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723/jenkins-hbase9.apache.org%2C34803%2C1689101231723.meta.1689101233438.meta 2023-07-11 18:47:13,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK], DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK], DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK]] 2023-07-11 18:47:13,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:13,478 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 18:47:13,498 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 18:47:13,505 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 18:47:13,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 18:47:13,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:13,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 18:47:13,513 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 18:47:13,517 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 18:47:13,519 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/info 2023-07-11 18:47:13,519 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/info 2023-07-11 18:47:13,520 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 18:47:13,520 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:13,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 18:47:13,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/rep_barrier 2023-07-11 18:47:13,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/rep_barrier 2023-07-11 18:47:13,523 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 18:47:13,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:13,525 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 18:47:13,527 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/table 2023-07-11 18:47:13,527 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/table 2023-07-11 18:47:13,527 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 18:47:13,528 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:13,531 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740 2023-07-11 18:47:13,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740 2023-07-11 18:47:13,537 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 18:47:13,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 18:47:13,541 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59226060, jitterRate=-0.11746293306350708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 18:47:13,541 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 18:47:13,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689101233402 2023-07-11 18:47:13,570 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 18:47:13,571 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 18:47:13,572 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,34803,1689101231723, state=OPEN 2023-07-11 18:47:13,575 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 18:47:13,575 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 18:47:13,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 18:47:13,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,34803,1689101231723 in 359 msec 2023-07-11 18:47:13,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 18:47:13,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 579 msec 2023-07-11 18:47:13,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 829 msec 2023-07-11 18:47:13,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689101233592, completionTime=-1 2023-07-11 18:47:13,592 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 18:47:13,592 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:47:13,656 DEBUG [hconnection-0x2c982b54-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:13,659 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:13,675 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 18:47:13,675 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689101293675 2023-07-11 18:47:13,676 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689101353676 2023-07-11 18:47:13,676 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 83 msec 2023-07-11 18:47:13,703 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42667,1689101230598-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,704 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42667,1689101230598-BalancerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,704 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42667,1689101230598-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,706 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:42667, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,706 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:13,712 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 18:47:13,720 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 18:47:13,722 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:13,731 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 18:47:13,733 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:13,736 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:13,757 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:13,759 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0 empty. 2023-07-11 18:47:13,760 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:13,760 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 18:47:13,795 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:13,797 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3865dd83a85f157967ba62a780042b0, NAME => 'hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:13,816 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:13,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c3865dd83a85f157967ba62a780042b0, disabling compactions & flushes 2023-07-11 18:47:13,817 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:47:13,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:47:13,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. after waiting 0 ms 2023-07-11 18:47:13,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:47:13,817 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:47:13,817 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c3865dd83a85f157967ba62a780042b0: 2023-07-11 18:47:13,821 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:13,836 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689101233824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101233824"}]},"ts":"1689101233824"} 2023-07-11 18:47:13,866 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:13,868 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:13,873 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101233868"}]},"ts":"1689101233868"} 2023-07-11 18:47:13,879 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 18:47:13,884 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:13,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:13,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:13,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:13,886 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:13,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c3865dd83a85f157967ba62a780042b0, ASSIGN}] 2023-07-11 18:47:13,893 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c3865dd83a85f157967ba62a780042b0, ASSIGN 2023-07-11 18:47:13,895 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c3865dd83a85f157967ba62a780042b0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:14,047 INFO [jenkins-hbase9:42667] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:14,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c3865dd83a85f157967ba62a780042b0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:14,049 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689101234048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101234048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101234048"}]},"ts":"1689101234048"} 2023-07-11 18:47:14,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c3865dd83a85f157967ba62a780042b0, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:14,213 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:47:14,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3865dd83a85f157967ba62a780042b0, NAME => 'hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:14,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:14,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:14,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:14,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:14,217 INFO [StoreOpener-c3865dd83a85f157967ba62a780042b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:14,219 DEBUG [StoreOpener-c3865dd83a85f157967ba62a780042b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/info 2023-07-11 18:47:14,219 DEBUG [StoreOpener-c3865dd83a85f157967ba62a780042b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/info 2023-07-11 18:47:14,220 INFO [StoreOpener-c3865dd83a85f157967ba62a780042b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3865dd83a85f157967ba62a780042b0 columnFamilyName info 2023-07-11 18:47:14,221 INFO [StoreOpener-c3865dd83a85f157967ba62a780042b0-1] regionserver.HStore(310): Store=c3865dd83a85f157967ba62a780042b0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:14,222 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:14,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:14,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c3865dd83a85f157967ba62a780042b0 2023-07-11 18:47:14,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:14,232 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c3865dd83a85f157967ba62a780042b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74937523, jitterRate=0.1166561096906662}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:14,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c3865dd83a85f157967ba62a780042b0: 2023-07-11 18:47:14,234 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0., pid=6, masterSystemTime=1689101234207 2023-07-11 18:47:14,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:47:14,237 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:47:14,239 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c3865dd83a85f157967ba62a780042b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:14,239 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689101234238"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101234238"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101234238"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101234238"}]},"ts":"1689101234238"} 2023-07-11 18:47:14,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 18:47:14,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c3865dd83a85f157967ba62a780042b0, server=jenkins-hbase9.apache.org,34803,1689101231723 in 189 msec 2023-07-11 18:47:14,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 18:47:14,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c3865dd83a85f157967ba62a780042b0, ASSIGN in 357 msec 2023-07-11 18:47:14,251 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:14,251 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101234251"}]},"ts":"1689101234251"} 2023-07-11 18:47:14,254 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 18:47:14,257 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:14,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 534 msec 2023-07-11 18:47:14,334 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 18:47:14,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 18:47:14,335 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:14,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 18:47:14,388 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 18:47:14,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-11 18:47:14,406 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:47:14,417 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 18:47:14,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-11 18:47:14,432 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 18:47:14,434 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 18:47:14,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.580sec 2023-07-11 18:47:14,437 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 18:47:14,439 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 18:47:14,439 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 18:47:14,440 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42667,1689101230598-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 18:47:14,441 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42667,1689101230598-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 18:47:14,449 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 18:47:14,529 DEBUG [Listener at localhost/44535] zookeeper.ReadOnlyZKClient(139): Connect 0x392999d1 to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:14,569 DEBUG [Listener at localhost/44535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1369daa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:14,583 DEBUG [hconnection-0x733222d1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:14,594 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:14,604 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:14,631 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testShutdownFixupWhenDaughterHasSplit Thread=363, OpenFileDescriptor=691, MaxFileDescriptor=60000, SystemLoadAverage=286, ProcessCount=170, AvailableMemoryMB=7972 2023-07-11 18:47:14,646 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 18:47:14,649 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 18:47:14,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testShutdownFixupWhenDaughterHasSplit', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:14,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:14,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:14,667 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:14,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testShutdownFixupWhenDaughterHasSplit" procId is: 9 2023-07-11 18:47:14,671 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:14,672 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a empty. 2023-07-11 18:47:14,674 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:14,674 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testShutdownFixupWhenDaughterHasSplit regions 2023-07-11 18:47:14,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:47:14,697 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:14,699 INFO [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => ff13f8e1c63474defaefc7d45bc4b08a, NAME => 'testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testShutdownFixupWhenDaughterHasSplit', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:14,719 DEBUG [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:14,719 DEBUG [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(1604): Closing ff13f8e1c63474defaefc7d45bc4b08a, disabling compactions & flushes 2023-07-11 18:47:14,719 INFO [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:14,719 DEBUG [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:14,720 DEBUG [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. after waiting 0 ms 2023-07-11 18:47:14,720 DEBUG [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:14,720 INFO [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:14,720 DEBUG [RegionOpenAndInit-testShutdownFixupWhenDaughterHasSplit-pool-0] regionserver.HRegion(1558): Region close journal for ff13f8e1c63474defaefc7d45bc4b08a: 2023-07-11 18:47:14,724 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:14,726 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101234726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101234726"}]},"ts":"1689101234726"} 2023-07-11 18:47:14,728 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:14,729 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:14,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101234730"}]},"ts":"1689101234730"} 2023-07-11 18:47:14,732 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testShutdownFixupWhenDaughterHasSplit, state=ENABLING in hbase:meta 2023-07-11 18:47:14,735 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:14,736 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:14,736 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:14,736 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:14,736 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:14,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=ff13f8e1c63474defaefc7d45bc4b08a, ASSIGN}] 2023-07-11 18:47:14,738 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=ff13f8e1c63474defaefc7d45bc4b08a, ASSIGN 2023-07-11 18:47:14,740 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=ff13f8e1c63474defaefc7d45bc4b08a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,41081,1689101231767; forceNewPlan=false, retain=false 2023-07-11 18:47:14,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:47:14,890 INFO [jenkins-hbase9:42667] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:14,891 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ff13f8e1c63474defaefc7d45bc4b08a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:14,892 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101234891"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101234891"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101234891"}]},"ts":"1689101234891"} 2023-07-11 18:47:14,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ff13f8e1c63474defaefc7d45bc4b08a, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:14,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:47:15,049 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:15,049 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:15,052 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:47:15,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:15,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff13f8e1c63474defaefc7d45bc4b08a, NAME => 'testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:15,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testShutdownFixupWhenDaughterHasSplit ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:15,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:15,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:15,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:15,060 INFO [StoreOpener-ff13f8e1c63474defaefc7d45bc4b08a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:15,062 DEBUG [StoreOpener-ff13f8e1c63474defaefc7d45bc4b08a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info 2023-07-11 18:47:15,062 DEBUG [StoreOpener-ff13f8e1c63474defaefc7d45bc4b08a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info 2023-07-11 18:47:15,063 INFO [StoreOpener-ff13f8e1c63474defaefc7d45bc4b08a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff13f8e1c63474defaefc7d45bc4b08a columnFamilyName info 2023-07-11 18:47:15,064 INFO [StoreOpener-ff13f8e1c63474defaefc7d45bc4b08a-1] regionserver.HStore(310): Store=ff13f8e1c63474defaefc7d45bc4b08a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:15,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:15,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:15,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:15,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:15,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ff13f8e1c63474defaefc7d45bc4b08a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60795359, jitterRate=-0.09407855570316315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:15,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ff13f8e1c63474defaefc7d45bc4b08a: 2023-07-11 18:47:15,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a., pid=11, masterSystemTime=1689101235049 2023-07-11 18:47:15,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:15,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:15,083 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ff13f8e1c63474defaefc7d45bc4b08a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:15,083 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101235082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101235082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101235082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101235082"}]},"ts":"1689101235082"} 2023-07-11 18:47:15,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 18:47:15,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ff13f8e1c63474defaefc7d45bc4b08a, server=jenkins-hbase9.apache.org,41081,1689101231767 in 191 msec 2023-07-11 18:47:15,092 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 18:47:15,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=ff13f8e1c63474defaefc7d45bc4b08a, ASSIGN in 353 msec 2023-07-11 18:47:15,094 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:15,094 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101235094"}]},"ts":"1689101235094"} 2023-07-11 18:47:15,096 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testShutdownFixupWhenDaughterHasSplit, state=ENABLED in hbase:meta 2023-07-11 18:47:15,099 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:15,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit in 437 msec 2023-07-11 18:47:15,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 18:47:15,290 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testShutdownFixupWhenDaughterHasSplit, procId: 9 completed 2023-07-11 18:47:15,290 DEBUG [Listener at localhost/44535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testShutdownFixupWhenDaughterHasSplit get assigned. Timeout = 60000ms 2023-07-11 18:47:15,292 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:15,296 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3484): All regions for table testShutdownFixupWhenDaughterHasSplit assigned to meta. Checking AM states. 2023-07-11 18:47:15,296 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:15,296 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3504): All regions for table testShutdownFixupWhenDaughterHasSplit assigned. 2023-07-11 18:47:15,298 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:15,298 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:15,298 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1032): MetaRegionServer=jenkins-hbase9.apache.org,34803,1689101231723, other=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:15,309 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:15,309 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:15,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=false 2023-07-11 18:47:15,414 DEBUG [hconnection-0x733222d1-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:15,467 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:15,498 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41081] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:15,880 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1078): Initial regions: testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:15,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:15,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] assignment.SplitTableRegionProcedure(206): testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:15,898 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] regionserver.HRegion(2745): Flushing ff13f8e1c63474defaefc7d45bc4b08a 1/1 column families, dataSize=583.58 KB heapSize=1.88 MB 2023-07-11 18:47:16,035 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=583.58 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/.tmp/info/596f85c5213e4455b143cc37d3080084 2023-07-11 18:47:16,078 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/.tmp/info/596f85c5213e4455b143cc37d3080084 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084 2023-07-11 18:47:16,088 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084, entries=17576, sequenceid=5, filesize=606.0 K 2023-07-11 18:47:16,090 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] regionserver.HRegion(2948): Finished flush of dataSize ~583.58 KB/597584, heapSize ~1.88 MB/1968752, currentSize=0 B/0 for ff13f8e1c63474defaefc7d45bc4b08a in 192ms, sequenceid=5, compaction requested=false 2023-07-11 18:47:16,092 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testShutdownFixupWhenDaughterHasSplit' 2023-07-11 18:47:16,093 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] regionserver.HRegion(2446): Flush status journal for ff13f8e1c63474defaefc7d45bc4b08a: 2023-07-11 18:47:16,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:16,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=ff13f8e1c63474defaefc7d45bc4b08a, daughterA=d110326d2f5fcd1365b84bd9c1da91a4, daughterB=383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,105 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=ff13f8e1c63474defaefc7d45bc4b08a, daughterA=d110326d2f5fcd1365b84bd9c1da91a4, daughterB=383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,105 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=ff13f8e1c63474defaefc7d45bc4b08a, daughterA=d110326d2f5fcd1365b84bd9c1da91a4, daughterB=383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,105 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=ff13f8e1c63474defaefc7d45bc4b08a, daughterA=d110326d2f5fcd1365b84bd9c1da91a4, daughterB=383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 18:47:16,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=ff13f8e1c63474defaefc7d45bc4b08a, UNASSIGN}] 2023-07-11 18:47:16,114 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=ff13f8e1c63474defaefc7d45bc4b08a, UNASSIGN 2023-07-11 18:47:16,115 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ff13f8e1c63474defaefc7d45bc4b08a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:16,115 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101236115"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101236115"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101236115"}]},"ts":"1689101236115"} 2023-07-11 18:47:16,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; CloseRegionProcedure ff13f8e1c63474defaefc7d45bc4b08a, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:16,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 18:47:16,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:16,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ff13f8e1c63474defaefc7d45bc4b08a, disabling compactions & flushes 2023-07-11 18:47:16,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:16,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:16,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. after waiting 0 ms 2023-07-11 18:47:16,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:16,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 18:47:16,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a. 2023-07-11 18:47:16,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ff13f8e1c63474defaefc7d45bc4b08a: 2023-07-11 18:47:16,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:16,292 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ff13f8e1c63474defaefc7d45bc4b08a, regionState=CLOSED 2023-07-11 18:47:16,292 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101236292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101236292"}]},"ts":"1689101236292"} 2023-07-11 18:47:16,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-07-11 18:47:16,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; CloseRegionProcedure ff13f8e1c63474defaefc7d45bc4b08a, server=jenkins-hbase9.apache.org,41081,1689101231767 in 177 msec 2023-07-11 18:47:16,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-11 18:47:16,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=ff13f8e1c63474defaefc7d45bc4b08a, UNASSIGN in 185 msec 2023-07-11 18:47:16,316 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=12 splitting 1 storefiles, region=ff13f8e1c63474defaefc7d45bc4b08a, threads=1 2023-07-11 18:47:16,318 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=12 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084 for region: ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:16,364 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=12 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084 for region: ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:16,364 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=12 split storefiles for region ff13f8e1c63474defaefc7d45bc4b08a Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:16,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 18:47:16,413 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-11 18:47:16,416 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-11 18:47:16,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101236419"},{"qualifier":"splitA","vlen":74,"tag":[],"timestamp":"1689101236419"},{"qualifier":"splitB","vlen":74,"tag":[],"timestamp":"1689101236419"}]},"ts":"1689101236419"} 2023-07-11 18:47:16,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101236419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101236419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101236419"}]},"ts":"1689101236419"} 2023-07-11 18:47:16,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101236419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101236419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101236419"}]},"ts":"1689101236419"} 2023-07-11 18:47:16,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, ASSIGN}, {pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=383e6bcb64774cf6ef214b50782ac346, ASSIGN}] 2023-07-11 18:47:16,471 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=383e6bcb64774cf6ef214b50782ac346, ASSIGN 2023-07-11 18:47:16,471 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, ASSIGN 2023-07-11 18:47:16,472 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=383e6bcb64774cf6ef214b50782ac346, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,41081,1689101231767; forceNewPlan=false, retain=false 2023-07-11 18:47:16,472 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,41081,1689101231767; forceNewPlan=false, retain=false 2023-07-11 18:47:16,622 INFO [jenkins-hbase9:42667] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:16,624 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d110326d2f5fcd1365b84bd9c1da91a4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:16,624 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=383e6bcb64774cf6ef214b50782ac346, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:16,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101236624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101236624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101236624"}]},"ts":"1689101236624"} 2023-07-11 18:47:16,624 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101236624"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101236624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101236624"}]},"ts":"1689101236624"} 2023-07-11 18:47:16,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 383e6bcb64774cf6ef214b50782ac346, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:16,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=18, ppid=15, state=RUNNABLE; OpenRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:16,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 18:47:16,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 383e6bcb64774cf6ef214b50782ac346, NAME => 'testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.', STARTKEY => 'nwf', ENDKEY => ''} 2023-07-11 18:47:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testShutdownFixupWhenDaughterHasSplit 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,787 INFO [StoreOpener-383e6bcb64774cf6ef214b50782ac346-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,788 DEBUG [StoreOpener-383e6bcb64774cf6ef214b50782ac346-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info 2023-07-11 18:47:16,788 DEBUG [StoreOpener-383e6bcb64774cf6ef214b50782ac346-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info 2023-07-11 18:47:16,789 INFO [StoreOpener-383e6bcb64774cf6ef214b50782ac346-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 383e6bcb64774cf6ef214b50782ac346 columnFamilyName info 2023-07-11 18:47:16,817 DEBUG [StoreOpener-383e6bcb64774cf6ef214b50782ac346-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084-top 2023-07-11 18:47:16,818 INFO [StoreOpener-383e6bcb64774cf6ef214b50782ac346-1] regionserver.HStore(310): Store=383e6bcb64774cf6ef214b50782ac346/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:16,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:16,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 383e6bcb64774cf6ef214b50782ac346; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64210423, jitterRate=-0.043190136551856995}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:16,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 383e6bcb64774cf6ef214b50782ac346: 2023-07-11 18:47:16,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346., pid=17, masterSystemTime=1689101236780 2023-07-11 18:47:16,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:16,830 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:16,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:16,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d110326d2f5fcd1365b84bd9c1da91a4, NAME => 'testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.', STARTKEY => '', ENDKEY => 'nwf'} 2023-07-11 18:47:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testShutdownFixupWhenDaughterHasSplit d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:16,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:16,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:16,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:16,833 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=383e6bcb64774cf6ef214b50782ac346, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:16,833 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:16,833 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101236833"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101236833"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101236833"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101236833"}]},"ts":"1689101236833"} 2023-07-11 18:47:16,833 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HStore(1912): 383e6bcb64774cf6ef214b50782ac346/info is initiating minor compaction (all files) 2023-07-11 18:47:16,834 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 383e6bcb64774cf6ef214b50782ac346/info in testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:16,834 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084-top] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/.tmp, totalSize=606.0 K 2023-07-11 18:47:16,835 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] compactions.Compactor(207): Compacting 596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a, keycount=8788, bloomtype=NONE, size=606.0 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689101235594 2023-07-11 18:47:16,838 INFO [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:16,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-07-11 18:47:16,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 383e6bcb64774cf6ef214b50782ac346, server=jenkins-hbase9.apache.org,41081,1689101231767 in 209 msec 2023-07-11 18:47:16,842 DEBUG [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info 2023-07-11 18:47:16,842 DEBUG [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info 2023-07-11 18:47:16,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=383e6bcb64774cf6ef214b50782ac346, ASSIGN in 371 msec 2023-07-11 18:47:16,843 INFO [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d110326d2f5fcd1365b84bd9c1da91a4 columnFamilyName info 2023-07-11 18:47:16,866 DEBUG [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084-bottom 2023-07-11 18:47:16,867 INFO [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] regionserver.HStore(310): Store=d110326d2f5fcd1365b84bd9c1da91a4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:16,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:16,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:16,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:16,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d110326d2f5fcd1365b84bd9c1da91a4; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60951651, jitterRate=-0.09174962341785431}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:16,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d110326d2f5fcd1365b84bd9c1da91a4: 2023-07-11 18:47:16,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4., pid=18, masterSystemTime=1689101236780 2023-07-11 18:47:16,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-11 18:47:16,878 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:16,880 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:16,881 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HStore(1912): d110326d2f5fcd1365b84bd9c1da91a4/info is initiating minor compaction (all files) 2023-07-11 18:47:16,881 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HRegion(2259): Starting compaction of d110326d2f5fcd1365b84bd9c1da91a4/info in testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:16,881 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084-bottom] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/.tmp, totalSize=606.0 K 2023-07-11 18:47:16,882 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] compactions.Compactor(207): Compacting 596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a, keycount=8788, bloomtype=NONE, size=606.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689101235594 2023-07-11 18:47:16,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:16,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:16,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=d110326d2f5fcd1365b84bd9c1da91a4, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:16,885 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101236884"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101236884"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101236884"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101236884"}]},"ts":"1689101236884"} 2023-07-11 18:47:16,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=15 2023-07-11 18:47:16,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=15, state=SUCCESS; OpenRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,41081,1689101231767 in 260 msec 2023-07-11 18:47:16,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=12 2023-07-11 18:47:16,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, ASSIGN in 422 msec 2023-07-11 18:47:16,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=ff13f8e1c63474defaefc7d45bc4b08a, daughterA=d110326d2f5fcd1365b84bd9c1da91a4, daughterB=383e6bcb64774cf6ef214b50782ac346 in 799 msec 2023-07-11 18:47:16,972 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] throttle.PressureAwareThroughputController(145): 383e6bcb64774cf6ef214b50782ac346#info#compaction#1 average throughput is 2.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:16,988 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/.tmp/info/f51a873bfcd34fed826bf0fd7b9100c1 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/f51a873bfcd34fed826bf0fd7b9100c1 2023-07-11 18:47:16,993 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] throttle.PressureAwareThroughputController(145): d110326d2f5fcd1365b84bd9c1da91a4#info#compaction#2 average throughput is 2.95 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:17,011 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/.tmp/info/898b5951b57d41b3b5453c0c45df2556 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/898b5951b57d41b3b5453c0c45df2556 2023-07-11 18:47:17,015 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 383e6bcb64774cf6ef214b50782ac346/info of 383e6bcb64774cf6ef214b50782ac346 into f51a873bfcd34fed826bf0fd7b9100c1(size=285.6 K), total size for store is 285.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:17,016 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 383e6bcb64774cf6ef214b50782ac346: 2023-07-11 18:47:17,016 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346., storeName=383e6bcb64774cf6ef214b50782ac346/info, priority=15, startTime=1689101236829; duration=0sec 2023-07-11 18:47:17,017 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:17,024 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in d110326d2f5fcd1365b84bd9c1da91a4/info of d110326d2f5fcd1365b84bd9c1da91a4 into 898b5951b57d41b3b5453c0c45df2556(size=325.0 K), total size for store is 325.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:17,025 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for d110326d2f5fcd1365b84bd9c1da91a4: 2023-07-11 18:47:17,025 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4., storeName=d110326d2f5fcd1365b84bd9c1da91a4/info, priority=15, startTime=1689101236878; duration=0sec 2023-07-11 18:47:17,025 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:17,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 18:47:17,215 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: SPLIT_REGION, Table Name: default:testShutdownFixupWhenDaughterHasSplit, procId: 12 completed 2023-07-11 18:47:17,215 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(577): Daughter we are going to split: {ENCODED => 383e6bcb64774cf6ef214b50782ac346, NAME => 'testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.', STARTKEY => 'nwf', ENDKEY => ''} 2023-07-11 18:47:17,217 DEBUG [Listener at localhost/44535] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:17,217 DEBUG [Listener at localhost/44535] regionserver.HStore(1912): 383e6bcb64774cf6ef214b50782ac346/info is initiating major compaction (all files) 2023-07-11 18:47:17,217 INFO [Listener at localhost/44535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:47:17,217 INFO [Listener at localhost/44535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:17,217 INFO [Listener at localhost/44535] regionserver.HRegion(2259): Starting compaction of 383e6bcb64774cf6ef214b50782ac346/info in testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:17,217 INFO [Listener at localhost/44535] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/f51a873bfcd34fed826bf0fd7b9100c1] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/.tmp, totalSize=285.6 K 2023-07-11 18:47:17,218 DEBUG [Listener at localhost/44535] compactions.Compactor(207): Compacting f51a873bfcd34fed826bf0fd7b9100c1, keycount=8211, bloomtype=NONE, size=285.6 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689101235594 2023-07-11 18:47:17,245 INFO [Listener at localhost/44535] throttle.PressureAwareThroughputController(145): 383e6bcb64774cf6ef214b50782ac346#info#compaction#3 average throughput is 13.31 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:17,259 DEBUG [Listener at localhost/44535] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/.tmp/info/4a65cf1049134edfb15bca1bd0ca4eaa as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa 2023-07-11 18:47:17,268 INFO [Listener at localhost/44535] regionserver.HStore(1652): Completed major compaction of 1 (all) file(s) in 383e6bcb64774cf6ef214b50782ac346/info of 383e6bcb64774cf6ef214b50782ac346 into 4a65cf1049134edfb15bca1bd0ca4eaa(size=285.6 K), total size for store is 285.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:17,269 DEBUG [Listener at localhost/44535] regionserver.HRegion(2289): Compaction status journal for 383e6bcb64774cf6ef214b50782ac346: 2023-07-11 18:47:17,272 DEBUG [Listener at localhost/44535] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084-top, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/f51a873bfcd34fed826bf0fd7b9100c1] to archive 2023-07-11 18:47:17,273 DEBUG [Listener at localhost/44535] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:17,278 DEBUG [Listener at localhost/44535] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:17,280 DEBUG [Listener at localhost/44535] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/f51a873bfcd34fed826bf0fd7b9100c1 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/f51a873bfcd34fed826bf0fd7b9100c1 2023-07-11 18:47:17,300 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(579): Finished testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. references=false 2023-07-11 18:47:17,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:17,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] assignment.SplitTableRegionProcedure(206): testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:17,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:17,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=383e6bcb64774cf6ef214b50782ac346, daughterA=46fcc7cc8626607b76b2955038597ba6, daughterB=613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,308 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=383e6bcb64774cf6ef214b50782ac346, daughterA=46fcc7cc8626607b76b2955038597ba6, daughterB=613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,308 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=383e6bcb64774cf6ef214b50782ac346, daughterA=46fcc7cc8626607b76b2955038597ba6, daughterB=613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,308 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=383e6bcb64774cf6ef214b50782ac346, daughterA=46fcc7cc8626607b76b2955038597ba6, daughterB=613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 18:47:17,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=383e6bcb64774cf6ef214b50782ac346, UNASSIGN}] 2023-07-11 18:47:17,312 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=383e6bcb64774cf6ef214b50782ac346, UNASSIGN 2023-07-11 18:47:17,313 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=383e6bcb64774cf6ef214b50782ac346, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:17,313 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101237313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101237313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101237313"}]},"ts":"1689101237313"} 2023-07-11 18:47:17,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; CloseRegionProcedure 383e6bcb64774cf6ef214b50782ac346, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:17,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 18:47:17,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:17,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 383e6bcb64774cf6ef214b50782ac346, disabling compactions & flushes 2023-07-11 18:47:17,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:17,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:17,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. after waiting 0 ms 2023-07-11 18:47:17,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:17,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=8 2023-07-11 18:47:17,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346. 2023-07-11 18:47:17,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 383e6bcb64774cf6ef214b50782ac346: 2023-07-11 18:47:17,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:17,484 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=383e6bcb64774cf6ef214b50782ac346, regionState=CLOSED 2023-07-11 18:47:17,485 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101237484"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101237484"}]},"ts":"1689101237484"} 2023-07-11 18:47:17,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-07-11 18:47:17,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; CloseRegionProcedure 383e6bcb64774cf6ef214b50782ac346, server=jenkins-hbase9.apache.org,41081,1689101231767 in 174 msec 2023-07-11 18:47:17,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-07-11 18:47:17,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=383e6bcb64774cf6ef214b50782ac346, UNASSIGN in 180 msec 2023-07-11 18:47:17,505 INFO [PEWorker-1] assignment.SplitTableRegionProcedure(694): pid=19 splitting 1 storefiles, region=383e6bcb64774cf6ef214b50782ac346, threads=1 2023-07-11 18:47:17,506 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=19 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa for region: 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:17,542 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=19 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa for region: 383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:17,542 DEBUG [PEWorker-1] assignment.SplitTableRegionProcedure(755): pid=19 split storefiles for region 383e6bcb64774cf6ef214b50782ac346 Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:17,579 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=-1 2023-07-11 18:47:17,581 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=-1 2023-07-11 18:47:17,583 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101237583"},{"qualifier":"splitA","vlen":77,"tag":[],"timestamp":"1689101237583"},{"qualifier":"splitB","vlen":74,"tag":[],"timestamp":"1689101237583"}]},"ts":"1689101237583"} 2023-07-11 18:47:17,584 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101237583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101237583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101237583"}]},"ts":"1689101237583"} 2023-07-11 18:47:17,584 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101237583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101237583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101237583"}]},"ts":"1689101237583"} 2023-07-11 18:47:17,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, ASSIGN}, {pid=23, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, ASSIGN}] 2023-07-11 18:47:17,590 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, ASSIGN 2023-07-11 18:47:17,590 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, ASSIGN 2023-07-11 18:47:17,591 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=22, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,41081,1689101231767; forceNewPlan=false, retain=false 2023-07-11 18:47:17,591 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,41081,1689101231767; forceNewPlan=false, retain=false 2023-07-11 18:47:17,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 18:47:17,741 INFO [jenkins-hbase9:42667] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:17,743 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=46fcc7cc8626607b76b2955038597ba6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:17,743 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=613b8f43341489d942acf5814ba6a43b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:17,743 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101237743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101237743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101237743"}]},"ts":"1689101237743"} 2023-07-11 18:47:17,743 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101237743"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101237743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101237743"}]},"ts":"1689101237743"} 2023-07-11 18:47:17,745 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; OpenRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:17,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:17,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:17,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 613b8f43341489d942acf5814ba6a43b, NAME => 'testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.', STARTKEY => 'tkh', ENDKEY => ''} 2023-07-11 18:47:17,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testShutdownFixupWhenDaughterHasSplit 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:17,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,904 INFO [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,905 DEBUG [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info 2023-07-11 18:47:17,905 DEBUG [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info 2023-07-11 18:47:17,906 INFO [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 613b8f43341489d942acf5814ba6a43b columnFamilyName info 2023-07-11 18:47:17,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 18:47:17,917 DEBUG [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa-top 2023-07-11 18:47:17,918 INFO [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] regionserver.HStore(310): Store=613b8f43341489d942acf5814ba6a43b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:17,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:17,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 613b8f43341489d942acf5814ba6a43b; next sequenceid=14; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59355303, jitterRate=-0.11553706228733063}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:17,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 613b8f43341489d942acf5814ba6a43b: 2023-07-11 18:47:17,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b., pid=25, masterSystemTime=1689101237898 2023-07-11 18:47:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:17,927 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:17,928 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:17,928 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HStore(1912): 613b8f43341489d942acf5814ba6a43b/info is initiating minor compaction (all files) 2023-07-11 18:47:17,928 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 613b8f43341489d942acf5814ba6a43b/info in testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:17,928 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa-top] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/.tmp, totalSize=285.6 K 2023-07-11 18:47:17,929 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] compactions.Compactor(207): Compacting 4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346, keycount=4105, bloomtype=NONE, size=285.6 K, encoding=NONE, compression=NONE, seqNum=7, earliestPutTs=1689101235594 2023-07-11 18:47:17,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:17,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:17,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:17,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46fcc7cc8626607b76b2955038597ba6, NAME => 'testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.', STARTKEY => 'nwf', ENDKEY => 'tkh'} 2023-07-11 18:47:17,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testShutdownFixupWhenDaughterHasSplit 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:17,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:17,930 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=613b8f43341489d942acf5814ba6a43b, regionState=OPEN, openSeqNum=14, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:17,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:17,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:17,930 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101237930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101237930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101237930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101237930"}]},"ts":"1689101237930"} 2023-07-11 18:47:17,932 INFO [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:17,933 DEBUG [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info 2023-07-11 18:47:17,933 DEBUG [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info 2023-07-11 18:47:17,934 INFO [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46fcc7cc8626607b76b2955038597ba6 columnFamilyName info 2023-07-11 18:47:17,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-11 18:47:17,942 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,41081,1689101231767 in 185 msec 2023-07-11 18:47:17,944 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, ASSIGN in 349 msec 2023-07-11 18:47:17,955 DEBUG [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa-bottom 2023-07-11 18:47:17,958 INFO [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] regionserver.HStore(310): Store=46fcc7cc8626607b76b2955038597ba6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:17,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:17,961 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] throttle.PressureAwareThroughputController(145): 613b8f43341489d942acf5814ba6a43b#info#compaction#4 average throughput is 5.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:17,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:17,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:17,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 46fcc7cc8626607b76b2955038597ba6; next sequenceid=14; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74637744, jitterRate=0.11218905448913574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:17,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 46fcc7cc8626607b76b2955038597ba6: 2023-07-11 18:47:17,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6., pid=24, masterSystemTime=1689101237898 2023-07-11 18:47:17,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-11 18:47:17,974 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:17,975 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:17,975 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HStore(1912): 46fcc7cc8626607b76b2955038597ba6/info is initiating minor compaction (all files) 2023-07-11 18:47:17,975 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 46fcc7cc8626607b76b2955038597ba6/info in testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:17,975 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa-bottom] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/.tmp, totalSize=285.6 K 2023-07-11 18:47:17,976 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] compactions.Compactor(207): Compacting 4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346, keycount=4105, bloomtype=NONE, size=285.6 K, encoding=NONE, compression=NONE, seqNum=6, earliestPutTs=1689101235594 2023-07-11 18:47:17,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:17,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:17,978 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=46fcc7cc8626607b76b2955038597ba6, regionState=OPEN, openSeqNum=14, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:17,979 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101237978"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101237978"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101237978"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101237978"}]},"ts":"1689101237978"} 2023-07-11 18:47:17,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-11 18:47:17,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; OpenRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,41081,1689101231767 in 236 msec 2023-07-11 18:47:17,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-07-11 18:47:17,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, ASSIGN in 398 msec 2023-07-11 18:47:17,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=383e6bcb64774cf6ef214b50782ac346, daughterA=46fcc7cc8626607b76b2955038597ba6, daughterB=613b8f43341489d942acf5814ba6a43b in 684 msec 2023-07-11 18:47:17,997 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/.tmp/info/89bbe1f4b18c43a19d882029ceb29096 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/89bbe1f4b18c43a19d882029ceb29096 2023-07-11 18:47:17,999 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] throttle.PressureAwareThroughputController(145): 46fcc7cc8626607b76b2955038597ba6#info#compaction#5 average throughput is 7.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:18,006 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 613b8f43341489d942acf5814ba6a43b/info of 613b8f43341489d942acf5814ba6a43b into 89bbe1f4b18c43a19d882029ceb29096(size=157.4 K), total size for store is 157.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:18,007 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 613b8f43341489d942acf5814ba6a43b: 2023-07-11 18:47:18,007 INFO [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b., storeName=613b8f43341489d942acf5814ba6a43b/info, priority=15, startTime=1689101237926; duration=0sec 2023-07-11 18:47:18,007 DEBUG [RS:1;jenkins-hbase9:41081-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:18,019 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/.tmp/info/14e83e6b39134f7c8ee3cc338dec97e4 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/14e83e6b39134f7c8ee3cc338dec97e4 2023-07-11 18:47:18,026 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 46fcc7cc8626607b76b2955038597ba6/info of 46fcc7cc8626607b76b2955038597ba6 into 14e83e6b39134f7c8ee3cc338dec97e4(size=132.7 K), total size for store is 132.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:18,026 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 46fcc7cc8626607b76b2955038597ba6: 2023-07-11 18:47:18,026 INFO [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6., storeName=46fcc7cc8626607b76b2955038597ba6/info, priority=15, startTime=1689101237973; duration=0sec 2023-07-11 18:47:18,026 DEBUG [RS:1;jenkins-hbase9:41081-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:18,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-07-11 18:47:18,416 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: SPLIT_REGION, Table Name: default:testShutdownFixupWhenDaughterHasSplit, procId: 19 completed 2023-07-11 18:47:18,416 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(584): Regions before crash: testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:18,416 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(584): Regions before crash: testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:18,416 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(584): Regions before crash: testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:18,417 INFO [Listener at localhost/44535] hbase.MiniHBaseCluster(482): Aborting jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,420 ERROR [Listener at localhost/44535] helpers.MarkerIgnoringBase(159): ***** ABORTING region server jenkins-hbase9.apache.org,41081,1689101231767: Aborting for tests ***** java.lang.Exception: Trace info at org.apache.hadoop.hbase.MiniHBaseCluster.abortRegionServer(MiniHBaseCluster.java:483) at org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster.testShutdownFixupWhenDaughterHasSplit(TestSplitTransactionOnCluster.java:587) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:18,421 ERROR [Listener at localhost/44535] helpers.MarkerIgnoringBase(143): RegionServer abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-11 18:47:18,424 DEBUG [Listener at localhost/44535] util.JSONBean(130): Listing beans for java.lang:type=Memory 2023-07-11 18:47:18,427 DEBUG [Listener at localhost/44535] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=IPC 2023-07-11 18:47:18,427 DEBUG [Listener at localhost/44535] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Replication 2023-07-11 18:47:18,428 DEBUG [Listener at localhost/44535] util.JSONBean(130): Listing beans for Hadoop:service=HBase,name=RegionServer,sub=Server 2023-07-11 18:47:18,428 INFO [Listener at localhost/44535] regionserver.HRegionServer(2557): Dump of metrics as JSON on abort: { "beans": [ { "name": "java.lang:type=Memory", "modelerType": "sun.management.MemoryImpl", "Verbose": false, "ObjectPendingFinalizationCount": 0, "HeapMemoryUsage": { "committed": 982515712, "init": 513802240, "max": 2051014656, "used": 355026616 }, "NonHeapMemoryUsage": { "committed": 126484480, "init": 2555904, "max": -1, "used": 123878224 }, "ObjectName": "java.lang:type=Memory" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType": "RegionServer,sub=IPC", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType": "RegionServer,sub=Replication", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ], "beans": [ { "name": "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType": "RegionServer,sub=Server", "tag.Context": "regionserver", "tag.Hostname": "jenkins-hbase9.apache.org" } ] } 2023-07-11 18:47:18,433 WARN [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42667] master.MasterRpcServices(612): jenkins-hbase9.apache.org,41081,1689101231767 reported a fatal error: ***** ABORTING region server jenkins-hbase9.apache.org,41081,1689101231767: Aborting for tests ***** Cause: java.lang.Exception: Trace info at org.apache.hadoop.hbase.MiniHBaseCluster.abortRegionServer(MiniHBaseCluster.java:483) at org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster.testShutdownFixupWhenDaughterHasSplit(TestSplitTransactionOnCluster.java:587) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:18,435 INFO [Listener at localhost/44535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,41081,1689101231767' ***** 2023-07-11 18:47:18,436 INFO [Listener at localhost/44535] regionserver.HRegionServer(2311): STOPPED: Aborting for tests 2023-07-11 18:47:18,436 INFO [RS:1;jenkins-hbase9:41081] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 18:47:18,437 INFO [RS:1;jenkins-hbase9:41081] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager abruptly. 2023-07-11 18:47:18,437 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 18:47:18,437 INFO [RS:1;jenkins-hbase9:41081] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager abruptly. 2023-07-11 18:47:18,437 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(594): Regions after crash: testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:18,437 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(3305): Received CLOSE for 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:18,437 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(594): Regions after crash: testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:18,437 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(594): Regions after crash: testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:18,437 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(601): Regions post crash testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6., contains=true 2023-07-11 18:47:18,437 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(601): Regions post crash testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b., contains=true 2023-07-11 18:47:18,437 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(3305): Received CLOSE for 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:18,437 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(601): Regions post crash testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4., contains=true 2023-07-11 18:47:18,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 46fcc7cc8626607b76b2955038597ba6, disabling compactions & flushes 2023-07-11 18:47:18,437 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(3305): Received CLOSE for d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:18,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:18,438 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(605): EXITING 2023-07-11 18:47:18,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:18,438 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1141): aborting server jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. after waiting 0 ms 2023-07-11 18:47:18,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:18,438 DEBUG [RS:1;jenkins-hbase9:41081] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e112f34 to 127.0.0.1:62848 2023-07-11 18:47:18,438 DEBUG [RS:1;jenkins-hbase9:41081] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:47:18,439 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-11 18:47:18,439 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1478): Online Regions={46fcc7cc8626607b76b2955038597ba6=testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6., 613b8f43341489d942acf5814ba6a43b=testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b., d110326d2f5fcd1365b84bd9c1da91a4=testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.} 2023-07-11 18:47:18,440 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa-bottom] to archive 2023-07-11 18:47:18,441 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:18,441 DEBUG [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1504): Waiting on 46fcc7cc8626607b76b2955038597ba6, 613b8f43341489d942acf5814ba6a43b, d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:18,442 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:18,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=true 2023-07-11 18:47:18,444 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:18,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:18,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 46fcc7cc8626607b76b2955038597ba6: 2023-07-11 18:47:18,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:18,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 613b8f43341489d942acf5814ba6a43b, disabling compactions & flushes 2023-07-11 18:47:18,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:18,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:18,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. after waiting 0 ms 2023-07-11 18:47:18,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:18,450 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa-top] to archive 2023-07-11 18:47:18,451 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:18,453 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:18,454 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(174): Tear down, remove table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:18,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:18,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 613b8f43341489d942acf5814ba6a43b: 2023-07-11 18:47:18,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:18,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d110326d2f5fcd1365b84bd9c1da91a4, disabling compactions & flushes 2023-07-11 18:47:18,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:18,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:18,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. after waiting 0 ms 2023-07-11 18:47:18,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:18,460 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:18,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:18,467 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084-bottom] to archive 2023-07-11 18:47:18,469 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:18,472 DEBUG [StoreCloser-testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:18,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:18,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d110326d2f5fcd1365b84bd9c1da91a4: 2023-07-11 18:47:18,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:18,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:18,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101238480"}]},"ts":"1689101238480"} 2023-07-11 18:47:18,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testShutdownFixupWhenDaughterHasSplit, state=DISABLING in hbase:meta 2023-07-11 18:47:18,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 18:47:18,487 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testShutdownFixupWhenDaughterHasSplit to state=DISABLING 2023-07-11 18:47:18,489 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, UNASSIGN}, {pid=28, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, UNASSIGN}, {pid=29, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, UNASSIGN}] 2023-07-11 18:47:18,492 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, UNASSIGN 2023-07-11 18:47:18,493 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, UNASSIGN 2023-07-11 18:47:18,493 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=27, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, UNASSIGN 2023-07-11 18:47:18,495 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=46fcc7cc8626607b76b2955038597ba6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=613b8f43341489d942acf5814ba6a43b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,495 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101238495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101238495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101238495"}]},"ts":"1689101238495"} 2023-07-11 18:47:18,495 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101238495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101238495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101238495"}]},"ts":"1689101238495"} 2023-07-11 18:47:18,496 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=d110326d2f5fcd1365b84bd9c1da91a4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,496 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101238496"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101238496"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101238496"}]},"ts":"1689101238496"} 2023-07-11 18:47:18,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; CloseRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:18,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=27, state=RUNNABLE; CloseRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:18,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; CloseRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,41081,1689101231767}] 2023-07-11 18:47:18,514 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:47:18,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 18:47:18,642 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,41081,1689101231767; all regions closed. 2023-07-11 18:47:18,653 DEBUG [RS:1;jenkins-hbase9:41081] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:47:18,653 INFO [RS:1;jenkins-hbase9:41081] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:47:18,654 INFO [RS:1;jenkins-hbase9:41081] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-11 18:47:18,654 INFO [RS:1;jenkins-hbase9:41081] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 18:47:18,654 INFO [RS:1;jenkins-hbase9:41081] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 18:47:18,654 INFO [RS:1;jenkins-hbase9:41081] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 18:47:18,654 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:47:18,655 INFO [RS:1;jenkins-hbase9:41081] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:41081 2023-07-11 18:47:18,655 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server jenkins-hbase9.apache.org,41081,1689101231767 aborting at org.apache.hadoop.hbase.regionserver.RSRpcServices.checkOpen(RSRpcServices.java:1524) at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3888) at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:34697) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:18,655 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41081] ipc.CallRunner(144): callId: 50 service: AdminService methodName: ExecuteProcedures size: 347 connection: 172.31.2.10:51160 deadline: 1689101298654, exception=org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server jenkins-hbase9.apache.org,41081,1689101231767 aborting 2023-07-11 18:47:18,656 DEBUG [RSProcedureDispatcher-pool-1] procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall(274): Request to jenkins-hbase9.apache.org,41081,1689101231767 failed, try=0 org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server jenkins-hbase9.apache.org,41081,1689101231767 aborting at org.apache.hadoop.hbase.regionserver.RSRpcServices.checkOpen(RSRpcServices.java:1524) at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3888) at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:34697) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:376) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:354) at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall.sendRequest(RSProcedureDispatcher.java:398) at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall.run(RSProcedureDispatcher.java:362) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.regionserver.RegionServerAbortedException): org.apache.hadoop.hbase.regionserver.RegionServerAbortedException: Server jenkins-hbase9.apache.org,41081,1689101231767 aborting at org.apache.hadoop.hbase.regionserver.RSRpcServices.checkOpen(RSRpcServices.java:1524) at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3888) at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:34697) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:382) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:162) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:192) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:800) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2023-07-11 18:47:18,657 WARN [RSProcedureDispatcher-pool-1] procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall(319): jenkins-hbase9.apache.org,41081,1689101231767 is aborted or stopped, for safety we still need to wait until it is fully dead, try=0 2023-07-11 18:47:18,664 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,664 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:47:18,664 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:47:18,664 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,664 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,664 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:47:18,664 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:47:18,665 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,41081,1689101231767] 2023-07-11 18:47:18,666 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,41081,1689101231767; numProcessing=1 2023-07-11 18:47:18,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:18,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:18,671 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,41081,1689101231767 already deleted, retry=false 2023-07-11 18:47:18,671 INFO [RegionServerTracker-0] master.ServerManager(568): Processing expiration of jenkins-hbase9.apache.org,41081,1689101231767 on jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:18,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:18,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:18,672 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 znode expired, triggering replicatorRemoved event 2023-07-11 18:47:18,672 INFO [zk-event-processor-pool-0] replication.ReplicationTrackerZKImpl$OtherRegionServerWatcher(124): /hbase/rs/jenkins-hbase9.apache.org,41081,1689101231767 znode expired, triggering replicatorRemoved event 2023-07-11 18:47:18,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:18,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:18,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:18,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:18,679 DEBUG [RegionServerTracker-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:SERVER_CRASH_START; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false 2023-07-11 18:47:18,679 INFO [RegionServerTracker-0] assignment.AssignmentManager(1734): Scheduled ServerCrashProcedure pid=33 for jenkins-hbase9.apache.org,41081,1689101231767 (carryingMeta=false) jenkins-hbase9.apache.org,41081,1689101231767/CRASHED/regionCount=3/lock=java.util.concurrent.locks.ReentrantReadWriteLock@1262904c[Write locks = 1, Read locks = 0], oldState=ONLINE. 2023-07-11 18:47:18,682 INFO [PEWorker-5] procedure.ServerCrashProcedure(161): Start pid=33, state=RUNNABLE:SERVER_CRASH_START, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false 2023-07-11 18:47:18,683 INFO [PEWorker-5] procedure.ServerCrashProcedure(199): jenkins-hbase9.apache.org,41081,1689101231767 had 3 regions 2023-07-11 18:47:18,685 INFO [PEWorker-5] procedure.ServerCrashProcedure(300): Splitting WALs pid=33, state=RUNNABLE:SERVER_CRASH_SPLIT_LOGS, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false, isMeta: false 2023-07-11 18:47:18,688 DEBUG [PEWorker-5] master.MasterWalManager(318): Renamed region directory: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting 2023-07-11 18:47:18,690 INFO [PEWorker-5] master.SplitWALManager(106): jenkins-hbase9.apache.org,41081,1689101231767 WAL count=1, meta=false 2023-07-11 18:47:18,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:ACQUIRE_SPLIT_WAL_WORKER; SplitWALProcedure jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268}] 2023-07-11 18:47:18,701 DEBUG [PEWorker-2] master.SplitWALManager(159): Acquired split WAL worker=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:18,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=35, ppid=34, state=RUNNABLE; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268, worker=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:18,758 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:18,758 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:41081 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:41081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:18,759 DEBUG [RSProcedureDispatcher-pool-2] procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall(274): Request to jenkins-hbase9.apache.org,41081,1689101231767 failed, try=1 java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:41081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:41081 at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:186) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:385) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:88) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:416) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:412) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.BufferCallBeforeInitHandler.userEventTriggered(BufferCallBeforeInitHandler.java:99) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:398) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireUserEventTriggered(AbstractChannelHandlerContext.java:368) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.userEventTriggered(DefaultChannelPipeline.java:1428) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:396) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeUserEventTriggered(AbstractChannelHandlerContext.java:376) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireUserEventTriggered(DefaultChannelPipeline.java:913) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.failInit(NettyRpcConnection.java:195) at org.apache.hadoop.hbase.ipc.NettyRpcConnection.access$300(NettyRpcConnection.java:76) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:296) at org.apache.hadoop.hbase.ipc.NettyRpcConnection$2.operationComplete(NettyRpcConnection.java:287) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:629) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:118) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:674) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:693) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:41081 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:18,760 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:41081 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:41081 2023-07-11 18:47:18,760 WARN [RSProcedureDispatcher-pool-2] procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall(310): Request to jenkins-hbase9.apache.org,41081,1689101231767 failed due to java.net.ConnectException: Call to address=jenkins-hbase9.apache.org/172.31.2.10:41081 failed on connection exception: org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:41081, try=1 and the server is not online, give up 2023-07-11 18:47:18,760 DEBUG [RSProcedureDispatcher-pool-2] assignment.RegionRemoteProcedureBase(122): pid=32, ppid=29, state=RUNNABLE; CloseRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,41081,1689101231767 for region state=CLOSING, location=jenkins-hbase9.apache.org,41081,1689101231767, table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, targetServer jenkins-hbase9.apache.org,41081,1689101231767 is dead, SCP will interrupt us, give up 2023-07-11 18:47:18,760 DEBUG [RSProcedureDispatcher-pool-2] assignment.RegionRemoteProcedureBase(122): pid=30, ppid=28, state=RUNNABLE; CloseRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,41081,1689101231767 for region state=CLOSING, location=jenkins-hbase9.apache.org,41081,1689101231767, table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, targetServer jenkins-hbase9.apache.org,41081,1689101231767 is dead, SCP will interrupt us, give up 2023-07-11 18:47:18,760 DEBUG [RSProcedureDispatcher-pool-2] assignment.RegionRemoteProcedureBase(122): pid=31, ppid=27, state=RUNNABLE; CloseRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,41081,1689101231767 for region state=CLOSING, location=jenkins-hbase9.apache.org,41081,1689101231767, table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, targetServer jenkins-hbase9.apache.org,41081,1689101231767 is dead, SCP will interrupt us, give up 2023-07-11 18:47:18,771 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:47:18,771 INFO [RS:1;jenkins-hbase9:41081] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,41081,1689101231767; zookeeper connection closed. 2023-07-11 18:47:18,771 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:41081-0x10155a8225f0002, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:47:18,771 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1c759e1d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1c759e1d 2023-07-11 18:47:18,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 18:47:18,864 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:18,865 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:18,867 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:47:18,869 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.RSRpcServices(3879): Executing remote procedure class org.apache.hadoop.hbase.regionserver.SplitWALCallable, pid=35 2023-07-11 18:47:18,889 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(300): Splitting hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268, size=657.9 K (673651bytes) 2023-07-11 18:47:18,890 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 2023-07-11 18:47:18,895 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 after 5ms 2023-07-11 18:47:18,901 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(311): Open hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 took 13ms 2023-07-11 18:47:18,916 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for ff13f8e1c63474defaefc7d45bc4b08a: last_flushed_sequence_id: 5 store_sequence_id { family_name: "info" sequence_id: 5 } 2023-07-11 18:47:18,968 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 383e6bcb64774cf6ef214b50782ac346: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "info" sequence_id: 18446744073709551615 } 2023-07-11 18:47:18,970 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for d110326d2f5fcd1365b84bd9c1da91a4: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "info" sequence_id: 18446744073709551615 } 2023-07-11 18:47:18,973 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 613b8f43341489d942acf5814ba6a43b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "info" sequence_id: 18446744073709551615 } 2023-07-11 18:47:18,975 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(346): Last flushed sequenceid for 46fcc7cc8626607b76b2955038597ba6: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "info" sequence_id: 18446744073709551615 } 2023-07-11 18:47:18,975 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(400): Finishing writing output for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 so closing down 2023-07-11 18:47:18,975 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.OutputSink(121): Waiting for split writer threads to finish 2023-07-11 18:47:18,978 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-1] util.CommonFSUtils$DfsBuilderUtility(753): Could not find replicate method on builder; will not set replicate when creating output stream java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DistributedFileSystem$HdfsDataOutputStreamBuilder.replicate() at java.lang.Class.getMethod(Class.java:1786) at org.apache.hadoop.hbase.util.CommonFSUtils$DfsBuilderUtility.(CommonFSUtils.java:750) at org.apache.hadoop.hbase.util.CommonFSUtils.createForWal(CommonFSUtils.java:802) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.initOutput(ProtobufLogWriter.java:102) at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:160) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:78) at org.apache.hadoop.hbase.wal.FSHLogProvider.createWriter(FSHLogProvider.java:62) at org.apache.hadoop.hbase.wal.WALFactory.createRecoveredEditsWriter(WALFactory.java:402) at org.apache.hadoop.hbase.wal.WALSplitter.createWriter(WALSplitter.java:516) at org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink.createRecoveredEditsWriter(AbstractRecoveredEditsOutputSink.java:69) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.getRecoveredEditsWriter(RecoveredEditsOutputSink.java:81) at org.apache.hadoop.hbase.wal.RecoveredEditsOutputSink.append(RecoveredEditsOutputSink.java:63) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.writeBuffer(OutputSink.java:249) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.doRun(OutputSink.java:241) at org.apache.hadoop.hbase.wal.OutputSink$WriterThread.run(OutputSink.java:211) 2023-07-11 18:47:18,985 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp 2023-07-11 18:47:18,986 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-0] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp 2023-07-11 18:47:18,987 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-1] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp 2023-07-11 18:47:18,992 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0-Writer-2] wal.AbstractRecoveredEditsOutputSink(71): Creating recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp 2023-07-11 18:47:18,992 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.OutputSink(146): 3 split writer threads finished 2023-07-11 18:47:19,032 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 18:47:19,035 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 18:47:19,036 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016 2023-07-11 18:47:19,041 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp (wrote 2 edits, skipped 0 edits in 1 ms) 2023-07-11 18:47:19,041 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:47:19,042 INFO [split-log-closeStream-pool-1] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016 2023-07-11 18:47:19,044 INFO [split-log-closeStream-pool-2] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000012 2023-07-11 18:47:19,078 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(90): Closed recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp (wrote 1 edits, skipped 0 edits in 0 ms) 2023-07-11 18:47:19,084 INFO [split-log-closeStream-pool-0] wal.AbstractRecoveredEditsOutputSink(123): Rename recovered edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011 2023-07-11 18:47:19,084 INFO [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(423): Processed 15 edits across 4 Regions in 182 ms; skipped=10; WAL=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268, size=657.9 K, length=673651, corrupted=false, cancelled=false 2023-07-11 18:47:19,084 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] wal.WALSplitter(426): Completed split of hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268, journal: Splitting hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268, size=657.9 K (673651bytes) at 1689101238890Finishing writing output for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 so closing down at 1689101238975 (+85 ms)Creating recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp at 1689101238985 (+10 ms)Creating recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp at 1689101238986 (+1 ms)Creating recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp at 1689101238987 (+1 ms)Creating recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp at 1689101238992 (+5 ms)3 split writer threads finished at 1689101238992Closed recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689101239032 (+40 ms)Closed recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689101239035 (+3 ms)Rename recovered edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016 at 1689101239036 (+1 ms)Closed recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp (wrote 2 edits, skipped 0 edits in 1 ms) at 1689101239041 (+5 ms)Rename recovered edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016 at 1689101239042 (+1 ms)Rename recovered edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000012 at 1689101239044 (+2 ms)Closed recovered edits writer path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp (wrote 1 edits, skipped 0 edits in 0 ms) at 1689101239078 (+34 ms)Rename recovered edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011-jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268.temp to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011 at 1689101239084 (+6 ms)Processed 15 edits across 4 Regions in 182 ms; skipped=10; WAL=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268, size=657.9 K, length=673651, corrupted=false, cancelled=false at 1689101239084 2023-07-11 18:47:19,085 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] regionserver.SplitLogWorker(136): Done splitting WAL hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 2023-07-11 18:47:19,088 DEBUG [RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0-0] regionserver.RemoteProcedureResultReporter(64): Successfully complete execution of pid=35 2023-07-11 18:47:19,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 18:47:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster(3641): Remote procedure done, pid=35 2023-07-11 18:47:19,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] wal.WALSplitUtil(141): Moved hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs 2023-07-11 18:47:19,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=34 2023-07-11 18:47:19,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=34, state=SUCCESS; SplitWALRemoteProcedure jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268, worker=jenkins-hbase9.apache.org,40505,1689101231800 in 397 msec 2023-07-11 18:47:19,108 DEBUG [PEWorker-4] master.SplitWALManager(173): Release split WAL worker=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:19,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=34, resume processing ppid=33 2023-07-11 18:47:19,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; SplitWALProcedure jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268, worker=jenkins-hbase9.apache.org,40505,1689101231800 in 417 msec 2023-07-11 18:47:19,116 INFO [PEWorker-5] master.SplitLogManager(171): hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting dir is empty, no logs to split. 2023-07-11 18:47:19,116 INFO [PEWorker-5] master.SplitWALManager(106): jenkins-hbase9.apache.org,41081,1689101231767 WAL count=0, meta=false 2023-07-11 18:47:19,116 DEBUG [PEWorker-5] procedure.ServerCrashProcedure(290): Check if jenkins-hbase9.apache.org,41081,1689101231767 WAL splitting is done? wals=0, meta=false 2023-07-11 18:47:19,120 INFO [PEWorker-5] procedure.ServerCrashProcedure(282): Remove WAL directory for jenkins-hbase9.apache.org,41081,1689101231767 failed, ignore...File hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,41081,1689101231767-splitting does not exist. 2023-07-11 18:47:19,122 INFO [PEWorker-5] procedure.ServerCrashProcedure(534): pid=33, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false found RIT pid=27, ppid=26, state=WAITING:REGION_STATE_TRANSITION_CONFIRM_CLOSED, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, UNASSIGN; state=CLOSING, location=jenkins-hbase9.apache.org,41081,1689101231767, table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,123 INFO [PEWorker-5] procedure.ServerCrashProcedure(534): pid=33, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false found RIT pid=29, ppid=26, state=WAITING:REGION_STATE_TRANSITION_CONFIRM_CLOSED, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, UNASSIGN; state=CLOSING, location=jenkins-hbase9.apache.org,41081,1689101231767, table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,125 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=d110326d2f5fcd1365b84bd9c1da91a4, regionState=ABNORMALLY_CLOSED 2023-07-11 18:47:19,125 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239125"},{"qualifier":"state","vlen":17,"tag":[],"timestamp":"1689101239125"}]},"ts":"1689101239125"} 2023-07-11 18:47:19,126 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=613b8f43341489d942acf5814ba6a43b, regionState=ABNORMALLY_CLOSED 2023-07-11 18:47:19,126 INFO [PEWorker-5] procedure.ServerCrashProcedure(534): pid=33, state=RUNNABLE:SERVER_CRASH_ASSIGN, locked=true; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false found RIT pid=28, ppid=26, state=WAITING:REGION_STATE_TRANSITION_CONFIRM_CLOSED, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, UNASSIGN; state=CLOSING, location=jenkins-hbase9.apache.org,41081,1689101231767, table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,126 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239126"},{"qualifier":"state","vlen":17,"tag":[],"timestamp":"1689101239126"}]},"ts":"1689101239126"} 2023-07-11 18:47:19,130 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=46fcc7cc8626607b76b2955038597ba6, regionState=ABNORMALLY_CLOSED 2023-07-11 18:47:19,130 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101239130"},{"qualifier":"state","vlen":17,"tag":[],"timestamp":"1689101239130"}]},"ts":"1689101239130"} 2023-07-11 18:47:19,132 INFO [PEWorker-5] procedure.ServerCrashProcedure(251): removed crashed server jenkins-hbase9.apache.org,41081,1689101231767 after splitting done 2023-07-11 18:47:19,132 DEBUG [PEWorker-5] master.DeadServer(114): Removed jenkins-hbase9.apache.org,41081,1689101231767 from processing; numProcessing=0 2023-07-11 18:47:19,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=27 2023-07-11 18:47:19,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=27, state=SUCCESS; CloseRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,41081,1689101231767 in 628 msec 2023-07-11 18:47:19,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-07-11 18:47:19,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; CloseRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,41081,1689101231767 in 626 msec 2023-07-11 18:47:19,135 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=27, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, UNASSIGN; state=ABNORMALLY_CLOSED, location=null; forceNewPlan=true, retain=false 2023-07-11 18:47:19,136 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, UNASSIGN; state=ABNORMALLY_CLOSED, location=null; forceNewPlan=true, retain=false 2023-07-11 18:47:19,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false in 459 msec 2023-07-11 18:47:19,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-11 18:47:19,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; CloseRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,41081,1689101231767 in 634 msec 2023-07-11 18:47:19,139 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=26, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, UNASSIGN; state=ABNORMALLY_CLOSED, location=null; forceNewPlan=true, retain=false 2023-07-11 18:47:19,149 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 18:47:19,150 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 18:47:19,285 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:19,290 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:19,290 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:19,290 DEBUG [jenkins-hbase9:42667] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:19,291 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=46fcc7cc8626607b76b2955038597ba6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:19,291 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=613b8f43341489d942acf5814ba6a43b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:19,291 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101239291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101239291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101239291"}]},"ts":"1689101239291"} 2023-07-11 18:47:19,291 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=d110326d2f5fcd1365b84bd9c1da91a4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:19,291 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101239291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101239291"}]},"ts":"1689101239291"} 2023-07-11 18:47:19,291 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101239291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101239291"}]},"ts":"1689101239291"} 2023-07-11 18:47:19,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=28, state=RUNNABLE; OpenRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:19,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=27, state=RUNNABLE; OpenRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:19,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=38, ppid=29, state=RUNNABLE; OpenRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:19,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:19,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:19,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d110326d2f5fcd1365b84bd9c1da91a4, NAME => 'testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.', STARTKEY => '', ENDKEY => 'nwf'} 2023-07-11 18:47:19,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46fcc7cc8626607b76b2955038597ba6, NAME => 'testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.', STARTKEY => 'nwf', ENDKEY => 'tkh'} 2023-07-11 18:47:19,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testShutdownFixupWhenDaughterHasSplit 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testShutdownFixupWhenDaughterHasSplit d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:19,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:19,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,454 INFO [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,455 INFO [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,456 DEBUG [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info 2023-07-11 18:47:19,456 DEBUG [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info 2023-07-11 18:47:19,456 DEBUG [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info 2023-07-11 18:47:19,456 DEBUG [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info 2023-07-11 18:47:19,456 INFO [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d110326d2f5fcd1365b84bd9c1da91a4 columnFamilyName info 2023-07-11 18:47:19,457 INFO [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46fcc7cc8626607b76b2955038597ba6 columnFamilyName info 2023-07-11 18:47:19,466 DEBUG [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/14e83e6b39134f7c8ee3cc338dec97e4 2023-07-11 18:47:19,467 INFO [StoreOpener-46fcc7cc8626607b76b2955038597ba6-1] regionserver.HStore(310): Store=46fcc7cc8626607b76b2955038597ba6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:19,467 DEBUG [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/898b5951b57d41b3b5453c0c45df2556 2023-07-11 18:47:19,467 INFO [StoreOpener-d110326d2f5fcd1365b84bd9c1da91a4-1] regionserver.HStore(310): Store=d110326d2f5fcd1365b84bd9c1da91a4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:19,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011 2023-07-11 18:47:19,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016 2023-07-11 18:47:19,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5510): d110326d2f5fcd1365b84bd9c1da91a4 : Replaying compaction marker table_name: "testShutdownFixupWhenDaughterHasSplit" encoded_region_name: "d110326d2f5fcd1365b84bd9c1da91a4" family_name: "info" compaction_input: "596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a" compaction_output: "898b5951b57d41b3b5453c0c45df2556" store_home_dir: "info" region_name: "testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4." with seqId=9223372036854775807 and lastReplayedOpenRegionSeqId=-1 2023-07-11 18:47:19,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5510): 46fcc7cc8626607b76b2955038597ba6 : Replaying compaction marker table_name: "testShutdownFixupWhenDaughterHasSplit" encoded_region_name: "46fcc7cc8626607b76b2955038597ba6" family_name: "info" compaction_input: "4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346" compaction_output: "14e83e6b39134f7c8ee3cc338dec97e4" store_home_dir: "info" region_name: "testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6." with seqId=9223372036854775807 and lastReplayedOpenRegionSeqId=-1 2023-07-11 18:47:19,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1669): Completing compaction from the WAL marker 2023-07-11 18:47:19,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1669): Completing compaction from the WAL marker 2023-07-11 18:47:19,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 0, skipped 1, firstSequenceIdInLog=16, maxSequenceIdInLog=16, path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016 2023-07-11 18:47:19,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 0, skipped 1, firstSequenceIdInLog=11, maxSequenceIdInLog=11, path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011 2023-07-11 18:47:19,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/0000000000000000011 2023-07-11 18:47:19,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/0000000000000000016 2023-07-11 18:47:19,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=8 2023-07-11 18:47:19,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/16.seqid, newMaxSeqId=16, maxSeqId=13 2023-07-11 18:47:19,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 46fcc7cc8626607b76b2955038597ba6; next sequenceid=17; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58738579, jitterRate=-0.12472696602344513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:19,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d110326d2f5fcd1365b84bd9c1da91a4; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75219967, jitterRate=0.1208648532629013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:19,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 46fcc7cc8626607b76b2955038597ba6: 2023-07-11 18:47:19,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d110326d2f5fcd1365b84bd9c1da91a4: 2023-07-11 18:47:19,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6., pid=36, masterSystemTime=1689101239445 2023-07-11 18:47:19,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4., pid=37, masterSystemTime=1689101239446 2023-07-11 18:47:19,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:19,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:19,493 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=46fcc7cc8626607b76b2955038597ba6, regionState=OPEN, openSeqNum=17, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:19,493 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101239493"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101239493"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101239493"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101239493"}]},"ts":"1689101239493"} 2023-07-11 18:47:19,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:19,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:19,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:19,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 613b8f43341489d942acf5814ba6a43b, NAME => 'testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.', STARTKEY => 'tkh', ENDKEY => ''} 2023-07-11 18:47:19,494 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=d110326d2f5fcd1365b84bd9c1da91a4, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:19,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testShutdownFixupWhenDaughterHasSplit 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,494 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239494"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101239494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101239494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101239494"}]},"ts":"1689101239494"} 2023-07-11 18:47:19,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:19,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,496 INFO [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=28 2023-07-11 18:47:19,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=28, state=SUCCESS; OpenRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,40505,1689101231800 in 202 msec 2023-07-11 18:47:19,498 DEBUG [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info 2023-07-11 18:47:19,498 DEBUG [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info 2023-07-11 18:47:19,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=27 2023-07-11 18:47:19,499 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=46fcc7cc8626607b76b2955038597ba6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:19,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=27, state=SUCCESS; OpenRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,34803,1689101231723 in 202 msec 2023-07-11 18:47:19,499 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101239499"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101239499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101239499"}]},"ts":"1689101239499"} 2023-07-11 18:47:19,500 INFO [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 613b8f43341489d942acf5814ba6a43b columnFamilyName info 2023-07-11 18:47:19,500 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=d110326d2f5fcd1365b84bd9c1da91a4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:19,500 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239500"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101239500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101239500"}]},"ts":"1689101239500"} 2023-07-11 18:47:19,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=28, state=RUNNABLE; CloseRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:19,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=27, state=RUNNABLE; CloseRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:19,514 DEBUG [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/89bbe1f4b18c43a19d882029ceb29096 2023-07-11 18:47:19,514 INFO [StoreOpener-613b8f43341489d942acf5814ba6a43b-1] regionserver.HStore(310): Store=613b8f43341489d942acf5814ba6a43b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:19,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 1 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016 2023-07-11 18:47:19,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5510): 613b8f43341489d942acf5814ba6a43b : Replaying compaction marker table_name: "testShutdownFixupWhenDaughterHasSplit" encoded_region_name: "613b8f43341489d942acf5814ba6a43b" family_name: "info" compaction_input: "4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346" compaction_output: "89bbe1f4b18c43a19d882029ceb29096" store_home_dir: "info" region_name: "testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b." with seqId=9223372036854775807 and lastReplayedOpenRegionSeqId=-1 2023-07-11 18:47:19,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1669): Completing compaction from the WAL marker 2023-07-11 18:47:19,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5464): Applied 0, skipped 1, firstSequenceIdInLog=16, maxSequenceIdInLog=16, path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016 2023-07-11 18:47:19,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/0000000000000000016 2023-07-11 18:47:19,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/16.seqid, newMaxSeqId=16, maxSeqId=13 2023-07-11 18:47:19,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 613b8f43341489d942acf5814ba6a43b; next sequenceid=17; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61185669, jitterRate=-0.08826248347759247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:19,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 613b8f43341489d942acf5814ba6a43b: 2023-07-11 18:47:19,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b., pid=38, masterSystemTime=1689101239446 2023-07-11 18:47:19,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:19,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:19,533 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=613b8f43341489d942acf5814ba6a43b, regionState=OPEN, openSeqNum=17, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:19,533 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239532"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101239532"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101239532"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101239532"}]},"ts":"1689101239532"} 2023-07-11 18:47:19,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=29 2023-07-11 18:47:19,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=29, state=SUCCESS; OpenRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,34803,1689101231723 in 240 msec 2023-07-11 18:47:19,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=613b8f43341489d942acf5814ba6a43b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:19,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101239538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101239538"}]},"ts":"1689101239538"} 2023-07-11 18:47:19,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=29, state=RUNNABLE; CloseRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:19,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 18:47:19,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 46fcc7cc8626607b76b2955038597ba6, disabling compactions & flushes 2023-07-11 18:47:19,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:19,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:19,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. after waiting 0 ms 2023-07-11 18:47:19,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:19,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 613b8f43341489d942acf5814ba6a43b, disabling compactions & flushes 2023-07-11 18:47:19,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:19,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:19,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. after waiting 0 ms 2023-07-11 18:47:19,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:19,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/19.seqid, newMaxSeqId=19, maxSeqId=16 2023-07-11 18:47:19,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/19.seqid, newMaxSeqId=19, maxSeqId=16 2023-07-11 18:47:19,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6. 2023-07-11 18:47:19,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 46fcc7cc8626607b76b2955038597ba6: 2023-07-11 18:47:19,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b. 2023-07-11 18:47:19,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 613b8f43341489d942acf5814ba6a43b: 2023-07-11 18:47:19,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:19,670 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=46fcc7cc8626607b76b2955038597ba6, regionState=CLOSED 2023-07-11 18:47:19,670 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"regioninfo","vlen":77,"tag":[],"timestamp":"1689101239670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101239670"}]},"ts":"1689101239670"} 2023-07-11 18:47:19,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:19,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d110326d2f5fcd1365b84bd9c1da91a4, disabling compactions & flushes 2023-07-11 18:47:19,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:19,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:19,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. after waiting 0 ms 2023-07-11 18:47:19,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:19,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=613b8f43341489d942acf5814ba6a43b, regionState=CLOSED 2023-07-11 18:47:19,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101239671"}]},"ts":"1689101239671"} 2023-07-11 18:47:19,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=28 2023-07-11 18:47:19,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=28, state=SUCCESS; CloseRegionProcedure 46fcc7cc8626607b76b2955038597ba6, server=jenkins-hbase9.apache.org,40505,1689101231800 in 172 msec 2023-07-11 18:47:19,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=29 2023-07-11 18:47:19,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=29, state=SUCCESS; CloseRegionProcedure 613b8f43341489d942acf5814ba6a43b, server=jenkins-hbase9.apache.org,34803,1689101231723 in 135 msec 2023-07-11 18:47:19,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=26, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=46fcc7cc8626607b76b2955038597ba6, UNASSIGN in 1.1880 sec 2023-07-11 18:47:19,680 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=26, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=613b8f43341489d942acf5814ba6a43b, UNASSIGN in 1.1890 sec 2023-07-11 18:47:19,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/14.seqid, newMaxSeqId=14, maxSeqId=11 2023-07-11 18:47:19,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4. 2023-07-11 18:47:19,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d110326d2f5fcd1365b84bd9c1da91a4: 2023-07-11 18:47:19,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:19,685 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=27 updating hbase:meta row=d110326d2f5fcd1365b84bd9c1da91a4, regionState=CLOSED 2023-07-11 18:47:19,685 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1689101239685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101239685"}]},"ts":"1689101239685"} 2023-07-11 18:47:19,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=27 2023-07-11 18:47:19,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=27, state=SUCCESS; CloseRegionProcedure d110326d2f5fcd1365b84bd9c1da91a4, server=jenkins-hbase9.apache.org,34803,1689101231723 in 185 msec 2023-07-11 18:47:19,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=26 2023-07-11 18:47:19,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=26, state=SUCCESS; TransitRegionStateProcedure table=testShutdownFixupWhenDaughterHasSplit, region=d110326d2f5fcd1365b84bd9c1da91a4, UNASSIGN in 1.2000 sec 2023-07-11 18:47:19,692 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101239692"}]},"ts":"1689101239692"} 2023-07-11 18:47:19,694 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testShutdownFixupWhenDaughterHasSplit, state=DISABLED in hbase:meta 2023-07-11 18:47:19,697 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testShutdownFixupWhenDaughterHasSplit to state=DISABLED 2023-07-11 18:47:19,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DisableTableProcedure table=testShutdownFixupWhenDaughterHasSplit in 1.2280 sec 2023-07-11 18:47:20,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 18:47:20,594 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testShutdownFixupWhenDaughterHasSplit, procId: 26 completed 2023-07-11 18:47:20,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:20,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:20,607 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=42, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:20,609 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=42, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:20,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 18:47:20,619 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:20,619 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:20,619 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:20,619 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:20,619 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:20,623 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits] 2023-07-11 18:47:20,625 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits] 2023-07-11 18:47:20,625 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits] 2023-07-11 18:47:20,625 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits] 2023-07-11 18:47:20,625 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits] 2023-07-11 18:47:20,637 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa 2023-07-11 18:47:20,637 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/898b5951b57d41b3b5453c0c45df2556 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/898b5951b57d41b3b5453c0c45df2556 2023-07-11 18:47:20,638 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/89bbe1f4b18c43a19d882029ceb29096 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/89bbe1f4b18c43a19d882029ceb29096 2023-07-11 18:47:20,639 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/14e83e6b39134f7c8ee3cc338dec97e4 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/14e83e6b39134f7c8ee3cc338dec97e4 2023-07-11 18:47:20,639 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084 2023-07-11 18:47:20,644 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/14.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/14.seqid 2023-07-11 18:47:20,644 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000012 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000012 2023-07-11 18:47:20,645 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4 2023-07-11 18:47:20,646 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/19.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/19.seqid 2023-07-11 18:47:20,646 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits/8.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits/8.seqid 2023-07-11 18:47:20,646 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/19.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/19.seqid 2023-07-11 18:47:20,647 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:20,647 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a 2023-07-11 18:47:20,647 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6 2023-07-11 18:47:20,647 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/13.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/13.seqid 2023-07-11 18:47:20,648 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:20,648 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testShutdownFixupWhenDaughterHasSplit regions 2023-07-11 18:47:20,651 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=42, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:20,674 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 5 rows of testShutdownFixupWhenDaughterHasSplit from hbase:meta 2023-07-11 18:47:20,678 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testShutdownFixupWhenDaughterHasSplit' descriptor. 2023-07-11 18:47:20,679 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=42, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:20,680 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testShutdownFixupWhenDaughterHasSplit' from region states. 2023-07-11 18:47:20,680 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101240680"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:20,680 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101240680"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:20,680 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101240680"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:20,680 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101240680"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:20,680 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101240680"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:20,683 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 5 regions from META 2023-07-11 18:47:20,683 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ff13f8e1c63474defaefc7d45bc4b08a, NAME => 'testShutdownFixupWhenDaughterHasSplit,,1689101234658.ff13f8e1c63474defaefc7d45bc4b08a.', STARTKEY => '', ENDKEY => ''}, {ENCODED => d110326d2f5fcd1365b84bd9c1da91a4, NAME => 'testShutdownFixupWhenDaughterHasSplit,,1689101236097.d110326d2f5fcd1365b84bd9c1da91a4.', STARTKEY => '', ENDKEY => 'nwf'}, {ENCODED => 383e6bcb64774cf6ef214b50782ac346, NAME => 'testShutdownFixupWhenDaughterHasSplit,nwf,1689101236097.383e6bcb64774cf6ef214b50782ac346.', STARTKEY => 'nwf', ENDKEY => ''}, {ENCODED => 46fcc7cc8626607b76b2955038597ba6, NAME => 'testShutdownFixupWhenDaughterHasSplit,nwf,1689101237306.46fcc7cc8626607b76b2955038597ba6.', STARTKEY => 'nwf', ENDKEY => 'tkh'}, {ENCODED => 613b8f43341489d942acf5814ba6a43b, NAME => 'testShutdownFixupWhenDaughterHasSplit,tkh,1689101237306.613b8f43341489d942acf5814ba6a43b.', STARTKEY => 'tkh', ENDKEY => ''}] 2023-07-11 18:47:20,683 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testShutdownFixupWhenDaughterHasSplit' as deleted. 2023-07-11 18:47:20,683 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testShutdownFixupWhenDaughterHasSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101240683"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:20,687 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testShutdownFixupWhenDaughterHasSplit state from META 2023-07-11 18:47:20,690 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=42, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:20,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit in 90 msec 2023-07-11 18:47:20,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 18:47:20,712 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testShutdownFixupWhenDaughterHasSplit, procId: 42 completed 2023-07-11 18:47:20,728 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testShutdownFixupWhenDaughterHasSplit Thread=348 (was 363), OpenFileDescriptor=724 (was 691) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 286) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=7905 (was 7972) 2023-07-11 18:47:20,740 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testMasterRestartAtRegionSplitPendingCatalogJanitor Thread=348, OpenFileDescriptor=724, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=170, AvailableMemoryMB=7904 2023-07-11 18:47:20,740 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:20,752 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 18:47:20,752 INFO [Listener at localhost/44535] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:47:20,752 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 18:47:20,753 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:20,753 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:20,753 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:47:20,753 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:20,753 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:47:20,753 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:47:20,756 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.2.10:33849 2023-07-11 18:47:20,756 INFO [Listener at localhost/44535] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 18:47:20,757 DEBUG [Listener at localhost/44535] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-11 18:47:20,758 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:20,759 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:20,760 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33849 connecting to ZooKeeper ensemble=127.0.0.1:62848 2023-07-11 18:47:20,763 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:338490x0, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:47:20,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33849-0x10155a8225f0009 connected 2023-07-11 18:47:20,765 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(162): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:47:20,766 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(162): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/running 2023-07-11 18:47:20,767 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:47:20,767 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33849 2023-07-11 18:47:20,769 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33849 2023-07-11 18:47:20,769 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33849 2023-07-11 18:47:20,770 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33849 2023-07-11 18:47:20,770 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33849 2023-07-11 18:47:20,772 INFO [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(951): ClusterId : 48047c0c-16f7-44b9-ae0d-0731457ba822 2023-07-11 18:47:20,772 DEBUG [RS:3;jenkins-hbase9:33849] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 18:47:20,774 DEBUG [RS:3;jenkins-hbase9:33849] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 18:47:20,775 DEBUG [RS:3;jenkins-hbase9:33849] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 18:47:20,781 DEBUG [RS:3;jenkins-hbase9:33849] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 18:47:20,782 DEBUG [RS:3;jenkins-hbase9:33849] zookeeper.ReadOnlyZKClient(139): Connect 0x3b4b133b to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:20,786 DEBUG [RS:3;jenkins-hbase9:33849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@358cfa22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:20,786 DEBUG [RS:3;jenkins-hbase9:33849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31b3784b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:47:20,794 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:3;jenkins-hbase9:33849 2023-07-11 18:47:20,794 INFO [RS:3;jenkins-hbase9:33849] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 18:47:20,794 INFO [RS:3;jenkins-hbase9:33849] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 18:47:20,794 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 18:47:20,795 INFO [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,42667,1689101230598 with isa=jenkins-hbase9.apache.org/172.31.2.10:33849, startcode=1689101240752 2023-07-11 18:47:20,795 DEBUG [RS:3;jenkins-hbase9:33849] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:20,798 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54595, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:20,799 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42667] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:20,799 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a 2023-07-11 18:47:20,799 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33811 2023-07-11 18:47:20,799 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 18:47:20,800 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:47:20,800 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:47:20,800 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:47:20,801 DEBUG [RS:3;jenkins-hbase9:33849] zookeeper.ZKUtil(162): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:20,801 WARN [RS:3;jenkins-hbase9:33849] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:47:20,801 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,33849,1689101240752] 2023-07-11 18:47:20,801 INFO [RS:3;jenkins-hbase9:33849] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:47:20,801 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:20,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:20,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:20,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:20,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:20,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:20,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:20,806 DEBUG [RS:3;jenkins-hbase9:33849] zookeeper.ZKUtil(162): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:20,806 DEBUG [RS:3;jenkins-hbase9:33849] zookeeper.ZKUtil(162): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:20,806 DEBUG [RS:3;jenkins-hbase9:33849] zookeeper.ZKUtil(162): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:20,807 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 18:47:20,808 INFO [RS:3;jenkins-hbase9:33849] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 18:47:20,810 INFO [RS:3;jenkins-hbase9:33849] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 18:47:20,812 INFO [RS:3;jenkins-hbase9:33849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:47:20,812 INFO [RS:3;jenkins-hbase9:33849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:20,812 INFO [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 18:47:20,814 INFO [RS:3;jenkins-hbase9:33849] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:20,814 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,814 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,814 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,814 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,814 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,814 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:47:20,815 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,815 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,815 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,815 DEBUG [RS:3;jenkins-hbase9:33849] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:20,817 INFO [RS:3;jenkins-hbase9:33849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:20,817 INFO [RS:3;jenkins-hbase9:33849] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:20,818 INFO [RS:3;jenkins-hbase9:33849] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:20,829 INFO [RS:3;jenkins-hbase9:33849] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 18:47:20,829 INFO [RS:3;jenkins-hbase9:33849] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,33849,1689101240752-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:20,840 INFO [RS:3;jenkins-hbase9:33849] regionserver.Replication(203): jenkins-hbase9.apache.org,33849,1689101240752 started 2023-07-11 18:47:20,840 INFO [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,33849,1689101240752, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:33849, sessionid=0x10155a8225f0009 2023-07-11 18:47:20,840 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3254): Started new server=Thread[RS:3;jenkins-hbase9:33849,5,FailOnTimeoutGroup] 2023-07-11 18:47:20,840 DEBUG [RS:3;jenkins-hbase9:33849] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 18:47:20,840 DEBUG [RS:3;jenkins-hbase9:33849] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:20,840 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:20,840 DEBUG [RS:3;jenkins-hbase9:33849] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33849,1689101240752' 2023-07-11 18:47:20,840 DEBUG [RS:3;jenkins-hbase9:33849] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:20,841 DEBUG [RS:3;jenkins-hbase9:33849] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:20,841 DEBUG [RS:3;jenkins-hbase9:33849] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 18:47:20,841 DEBUG [RS:3;jenkins-hbase9:33849] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 18:47:20,841 DEBUG [RS:3;jenkins-hbase9:33849] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:20,842 DEBUG [RS:3;jenkins-hbase9:33849] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,33849,1689101240752' 2023-07-11 18:47:20,842 DEBUG [RS:3;jenkins-hbase9:33849] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 18:47:20,842 DEBUG [RS:3;jenkins-hbase9:33849] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 18:47:20,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testMasterRestartAtRegionSplitPendingCatalogJanitor', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:20,843 DEBUG [RS:3;jenkins-hbase9:33849] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 18:47:20,843 INFO [RS:3;jenkins-hbase9:33849] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 18:47:20,843 INFO [RS:3;jenkins-hbase9:33849] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 18:47:20,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:20,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=43, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:20,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMasterRestartAtRegionSplitPendingCatalogJanitor" procId is: 43 2023-07-11 18:47:20,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=43, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:20,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-07-11 18:47:20,848 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:20,849 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c empty. 2023-07-11 18:47:20,850 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:20,850 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMasterRestartAtRegionSplitPendingCatalogJanitor regions 2023-07-11 18:47:20,866 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:20,868 INFO [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMasterRestartAtRegionSplitPendingCatalogJanitor', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:20,882 DEBUG [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(866): Instantiated testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:20,882 DEBUG [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(1604): Closing 1a043584b185b695c44ad7c0f652836c, disabling compactions & flushes 2023-07-11 18:47:20,882 INFO [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(1626): Closing region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:20,882 DEBUG [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:20,882 DEBUG [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(1714): Acquired close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. after waiting 0 ms 2023-07-11 18:47:20,882 DEBUG [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(1724): Updates disabled for region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:20,882 INFO [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(1838): Closed testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:20,882 DEBUG [RegionOpenAndInit-testMasterRestartAtRegionSplitPendingCatalogJanitor-pool-0] regionserver.HRegion(1558): Region close journal for 1a043584b185b695c44ad7c0f652836c: 2023-07-11 18:47:20,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=43, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:20,886 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101240886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101240886"}]},"ts":"1689101240886"} 2023-07-11 18:47:20,888 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:20,889 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=43, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:20,889 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101240889"}]},"ts":"1689101240889"} 2023-07-11 18:47:20,890 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMasterRestartAtRegionSplitPendingCatalogJanitor, state=ENABLING in hbase:meta 2023-07-11 18:47:20,899 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:20,900 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:20,900 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:20,900 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:20,900 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:20,900 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, ASSIGN}] 2023-07-11 18:47:20,902 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, ASSIGN 2023-07-11 18:47:20,905 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=43, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:20,945 INFO [RS:3;jenkins-hbase9:33849] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C33849%2C1689101240752, suffix=, logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,33849,1689101240752, archiveDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs, maxLogs=32 2023-07-11 18:47:20,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-07-11 18:47:20,965 DEBUG [RS-EventLoopGroup-7-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK] 2023-07-11 18:47:20,965 DEBUG [RS-EventLoopGroup-7-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK] 2023-07-11 18:47:20,966 DEBUG [RS-EventLoopGroup-7-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK] 2023-07-11 18:47:20,974 INFO [RS:3;jenkins-hbase9:33849] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,33849,1689101240752/jenkins-hbase9.apache.org%2C33849%2C1689101240752.1689101240946 2023-07-11 18:47:20,974 DEBUG [RS:3;jenkins-hbase9:33849] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK], DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK], DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK]] 2023-07-11 18:47:21,055 INFO [jenkins-hbase9:42667] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:21,056 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1a043584b185b695c44ad7c0f652836c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:21,056 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101241056"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101241056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101241056"}]},"ts":"1689101241056"} 2023-07-11 18:47:21,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 1a043584b185b695c44ad7c0f652836c, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:21,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-07-11 18:47:21,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:21,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMasterRestartAtRegionSplitPendingCatalogJanitor 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:21,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,218 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,219 DEBUG [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info 2023-07-11 18:47:21,219 DEBUG [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info 2023-07-11 18:47:21,220 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a043584b185b695c44ad7c0f652836c columnFamilyName info 2023-07-11 18:47:21,220 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] regionserver.HStore(310): Store=1a043584b185b695c44ad7c0f652836c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:21,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:21,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1a043584b185b695c44ad7c0f652836c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69399952, jitterRate=0.03413987159729004}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:21,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1a043584b185b695c44ad7c0f652836c: 2023-07-11 18:47:21,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c., pid=45, masterSystemTime=1689101241211 2023-07-11 18:47:21,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,231 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=1a043584b185b695c44ad7c0f652836c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:21,232 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101241231"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101241231"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101241231"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101241231"}]},"ts":"1689101241231"} 2023-07-11 18:47:21,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-11 18:47:21,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 1a043584b185b695c44ad7c0f652836c, server=jenkins-hbase9.apache.org,34803,1689101231723 in 174 msec 2023-07-11 18:47:21,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-07-11 18:47:21,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, ASSIGN in 336 msec 2023-07-11 18:47:21,239 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=43, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:21,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101241239"}]},"ts":"1689101241239"} 2023-07-11 18:47:21,241 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMasterRestartAtRegionSplitPendingCatalogJanitor, state=ENABLED in hbase:meta 2023-07-11 18:47:21,244 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=43, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:21,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor in 401 msec 2023-07-11 18:47:21,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-07-11 18:47:21,452 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMasterRestartAtRegionSplitPendingCatalogJanitor, procId: 43 completed 2023-07-11 18:47:21,452 DEBUG [Listener at localhost/44535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testMasterRestartAtRegionSplitPendingCatalogJanitor get assigned. Timeout = 60000ms 2023-07-11 18:47:21,452 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:21,457 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3484): All regions for table testMasterRestartAtRegionSplitPendingCatalogJanitor assigned to meta. Checking AM states. 2023-07-11 18:47:21,457 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:21,457 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3504): All regions for table testMasterRestartAtRegionSplitPendingCatalogJanitor assigned. 2023-07-11 18:47:21,458 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:21,458 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:21,458 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1032): MetaRegionServer=jenkins-hbase9.apache.org,34803,1689101231723, other=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:21,458 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1038): Moving testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. from jenkins-hbase9.apache.org,34803,1689101231723 to jenkins-hbase9.apache.org,40505,1689101231800; metaServerIndex=0 2023-07-11 18:47:21,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.RSRpcServices(2149): Warmup testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(7956): Warmup {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:21,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(866): Instantiated testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:21,471 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,472 DEBUG [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info 2023-07-11 18:47:21,472 DEBUG [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info 2023-07-11 18:47:21,473 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a043584b185b695c44ad7c0f652836c columnFamilyName info 2023-07-11 18:47:21,473 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] regionserver.HStore(310): Store=1a043584b185b695c44ad7c0f652836c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:21,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1604): Closing 1a043584b185b695c44ad7c0f652836c, disabling compactions & flushes 2023-07-11 18:47:21,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1626): Closing region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1647): Waiting without time limit for close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1714): Acquired close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. after waiting 0 ms 2023-07-11 18:47:21,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1724): Updates disabled for region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1838): Closed testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1558): Region close journal for 1a043584b185b695c44ad7c0f652836c: 2023-07-11 18:47:21,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster(2072): Client=jenkins//172.31.2.10 move hri=1a043584b185b695c44ad7c0f652836c, source=jenkins-hbase9.apache.org,34803,1689101231723, destination=jenkins-hbase9.apache.org,40505,1689101231800, running balancer 2023-07-11 18:47:21,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure2.ProcedureExecutor(1029): Stored pid=46, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, REOPEN/MOVE 2023-07-11 18:47:21,478 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=46, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, REOPEN/MOVE 2023-07-11 18:47:21,479 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=46 updating hbase:meta row=1a043584b185b695c44ad7c0f652836c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:21,479 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101241479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101241479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101241479"}]},"ts":"1689101241479"} 2023-07-11 18:47:21,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=46, state=RUNNABLE; CloseRegionProcedure 1a043584b185b695c44ad7c0f652836c, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:21,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure.ProcedureSyncWait(216): waitFor pid=46 2023-07-11 18:47:21,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1a043584b185b695c44ad7c0f652836c, disabling compactions & flushes 2023-07-11 18:47:21,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. after waiting 0 ms 2023-07-11 18:47:21,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:47:21,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1a043584b185b695c44ad7c0f652836c: 2023-07-11 18:47:21,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3513): Adding 1a043584b185b695c44ad7c0f652836c move to jenkins-hbase9.apache.org,40505,1689101231800 record at close sequenceid=2 2023-07-11 18:47:21,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,642 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=46 updating hbase:meta row=1a043584b185b695c44ad7c0f652836c, regionState=CLOSED 2023-07-11 18:47:21,642 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101241642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101241642"}]},"ts":"1689101241642"} 2023-07-11 18:47:21,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=46 2023-07-11 18:47:21,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=46, state=SUCCESS; CloseRegionProcedure 1a043584b185b695c44ad7c0f652836c, server=jenkins-hbase9.apache.org,34803,1689101231723 in 163 msec 2023-07-11 18:47:21,647 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=46, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:21,797 INFO [jenkins-hbase9:42667] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:21,797 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=46 updating hbase:meta row=1a043584b185b695c44ad7c0f652836c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:21,798 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101241797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101241797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101241797"}]},"ts":"1689101241797"} 2023-07-11 18:47:21,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=46, state=RUNNABLE; OpenRegionProcedure 1a043584b185b695c44ad7c0f652836c, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:21,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:21,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMasterRestartAtRegionSplitPendingCatalogJanitor 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:21,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,957 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,958 DEBUG [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info 2023-07-11 18:47:21,958 DEBUG [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info 2023-07-11 18:47:21,959 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a043584b185b695c44ad7c0f652836c columnFamilyName info 2023-07-11 18:47:21,959 INFO [StoreOpener-1a043584b185b695c44ad7c0f652836c-1] regionserver.HStore(310): Store=1a043584b185b695c44ad7c0f652836c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:21,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:21,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1a043584b185b695c44ad7c0f652836c; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73772534, jitterRate=0.09929642081260681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:21,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1a043584b185b695c44ad7c0f652836c: 2023-07-11 18:47:21,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c., pid=48, masterSystemTime=1689101241951 2023-07-11 18:47:21,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:21,969 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=46 updating hbase:meta row=1a043584b185b695c44ad7c0f652836c, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:21,970 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101241969"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101241969"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101241969"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101241969"}]},"ts":"1689101241969"} 2023-07-11 18:47:21,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=46 2023-07-11 18:47:21,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=46, state=SUCCESS; OpenRegionProcedure 1a043584b185b695c44ad7c0f652836c, server=jenkins-hbase9.apache.org,40505,1689101231800 in 172 msec 2023-07-11 18:47:21,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, REOPEN/MOVE in 497 msec 2023-07-11 18:47:21,982 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:21,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=false 2023-07-11 18:47:22,049 DEBUG [hconnection-0x733222d1-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:22,079 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:22,096 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:22,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(8805): writing data to region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 18:47:22,239 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1078): Initial regions: testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:22,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:22,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] assignment.SplitTableRegionProcedure(206): testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:22,244 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HRegion(2745): Flushing 1a043584b185b695c44ad7c0f652836c 1/1 column families, dataSize=583.58 KB heapSize=1.88 MB 2023-07-11 18:47:22,327 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=583.58 KB at sequenceid=8 (bloomFilter=false), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/.tmp/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 2023-07-11 18:47:22,338 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/.tmp/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 2023-07-11 18:47:22,345 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54, entries=17576, sequenceid=8, filesize=606.0 K 2023-07-11 18:47:22,348 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HRegion(2948): Finished flush of dataSize ~583.58 KB/597584, heapSize ~1.88 MB/1968752, currentSize=0 B/0 for 1a043584b185b695c44ad7c0f652836c in 104ms, sequenceid=8, compaction requested=false 2023-07-11 18:47:22,348 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMasterRestartAtRegionSplitPendingCatalogJanitor' 2023-07-11 18:47:22,348 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HRegion(2446): Flush status journal for 1a043584b185b695c44ad7c0f652836c: 2023-07-11 18:47:22,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:22,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, parent=1a043584b185b695c44ad7c0f652836c, daughterA=22be79dbd2c59d446651c6f009aeee63, daughterB=8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,351 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=49, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, parent=1a043584b185b695c44ad7c0f652836c, daughterA=22be79dbd2c59d446651c6f009aeee63, daughterB=8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,351 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=49, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, parent=1a043584b185b695c44ad7c0f652836c, daughterA=22be79dbd2c59d446651c6f009aeee63, daughterB=8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,351 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=49, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, parent=1a043584b185b695c44ad7c0f652836c, daughterA=22be79dbd2c59d446651c6f009aeee63, daughterB=8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-07-11 18:47:22,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, UNASSIGN}] 2023-07-11 18:47:22,356 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=50, ppid=49, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, UNASSIGN 2023-07-11 18:47:22,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=50 updating hbase:meta row=1a043584b185b695c44ad7c0f652836c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:22,357 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101242357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101242357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101242357"}]},"ts":"1689101242357"} 2023-07-11 18:47:22,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE; CloseRegionProcedure 1a043584b185b695c44ad7c0f652836c, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:22,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-07-11 18:47:22,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:22,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1a043584b185b695c44ad7c0f652836c, disabling compactions & flushes 2023-07-11 18:47:22,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:22,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:22,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. after waiting 0 ms 2023-07-11 18:47:22,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:22,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=4 2023-07-11 18:47:22,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:22,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1a043584b185b695c44ad7c0f652836c: 2023-07-11 18:47:22,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:22,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=50 updating hbase:meta row=1a043584b185b695c44ad7c0f652836c, regionState=CLOSED 2023-07-11 18:47:22,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101242531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101242531"}]},"ts":"1689101242531"} 2023-07-11 18:47:22,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-07-11 18:47:22,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; CloseRegionProcedure 1a043584b185b695c44ad7c0f652836c, server=jenkins-hbase9.apache.org,40505,1689101231800 in 171 msec 2023-07-11 18:47:22,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-07-11 18:47:22,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, UNASSIGN in 181 msec 2023-07-11 18:47:22,547 INFO [PEWorker-3] assignment.SplitTableRegionProcedure(694): pid=49 splitting 1 storefiles, region=1a043584b185b695c44ad7c0f652836c, threads=1 2023-07-11 18:47:22,547 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=49 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 for region: 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:22,579 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=49 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 for region: 1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:22,579 DEBUG [PEWorker-3] assignment.SplitTableRegionProcedure(755): pid=49 split storefiles for region 1a043584b185b695c44ad7c0f652836c Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:22,617 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=-1 2023-07-11 18:47:22,619 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=-1 2023-07-11 18:47:22,621 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"regioninfo","vlen":85,"tag":[],"timestamp":"1689101242621"},{"qualifier":"splitA","vlen":88,"tag":[],"timestamp":"1689101242621"},{"qualifier":"splitB","vlen":88,"tag":[],"timestamp":"1689101242621"}]},"ts":"1689101242621"} 2023-07-11 18:47:22,621 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101242621"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101242621"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101242621"}]},"ts":"1689101242621"} 2023-07-11 18:47:22,621 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101242621"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101242621"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101242621"}]},"ts":"1689101242621"} 2023-07-11 18:47:22,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=49, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=22be79dbd2c59d446651c6f009aeee63, ASSIGN}, {pid=53, ppid=49, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=8839cd6364743d0ae1f1090faca02423, ASSIGN}] 2023-07-11 18:47:22,626 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=49, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=8839cd6364743d0ae1f1090faca02423, ASSIGN 2023-07-11 18:47:22,626 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=49, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=22be79dbd2c59d446651c6f009aeee63, ASSIGN 2023-07-11 18:47:22,626 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=53, ppid=49, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=8839cd6364743d0ae1f1090faca02423, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:22,626 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=52, ppid=49, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=22be79dbd2c59d446651c6f009aeee63, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:22,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-07-11 18:47:22,777 INFO [jenkins-hbase9:42667] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:22,779 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8839cd6364743d0ae1f1090faca02423, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:22,779 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=22be79dbd2c59d446651c6f009aeee63, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:22,779 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101242778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101242778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101242778"}]},"ts":"1689101242778"} 2023-07-11 18:47:22,779 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101242779"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101242779"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101242779"}]},"ts":"1689101242779"} 2023-07-11 18:47:22,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; OpenRegionProcedure 8839cd6364743d0ae1f1090faca02423, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:22,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; OpenRegionProcedure 22be79dbd2c59d446651c6f009aeee63, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:22,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:22,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8839cd6364743d0ae1f1090faca02423, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.', STARTKEY => 'nwf', ENDKEY => ''} 2023-07-11 18:47:22,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMasterRestartAtRegionSplitPendingCatalogJanitor 8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:22,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,940 INFO [StoreOpener-8839cd6364743d0ae1f1090faca02423-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,941 DEBUG [StoreOpener-8839cd6364743d0ae1f1090faca02423-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info 2023-07-11 18:47:22,941 DEBUG [StoreOpener-8839cd6364743d0ae1f1090faca02423-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info 2023-07-11 18:47:22,941 INFO [StoreOpener-8839cd6364743d0ae1f1090faca02423-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8839cd6364743d0ae1f1090faca02423 columnFamilyName info 2023-07-11 18:47:22,951 DEBUG [StoreOpener-8839cd6364743d0ae1f1090faca02423-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54-top 2023-07-11 18:47:22,951 INFO [StoreOpener-8839cd6364743d0ae1f1090faca02423-1] regionserver.HStore(310): Store=8839cd6364743d0ae1f1090faca02423/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:22,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:22,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-07-11 18:47:22,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8839cd6364743d0ae1f1090faca02423; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71479329, jitterRate=0.0651250034570694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:22,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8839cd6364743d0ae1f1090faca02423: 2023-07-11 18:47:22,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423., pid=54, masterSystemTime=1689101242934 2023-07-11 18:47:22,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:22,963 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:22,964 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:22,964 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1912): 8839cd6364743d0ae1f1090faca02423/info is initiating minor compaction (all files) 2023-07-11 18:47:22,964 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8839cd6364743d0ae1f1090faca02423/info in testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:22,965 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54-top] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/.tmp, totalSize=606.0 K 2023-07-11 18:47:22,965 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c, keycount=8788, bloomtype=NONE, size=606.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689101242150 2023-07-11 18:47:22,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:22,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:22,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:22,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 22be79dbd2c59d446651c6f009aeee63, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.', STARTKEY => '', ENDKEY => 'nwf'} 2023-07-11 18:47:22,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMasterRestartAtRegionSplitPendingCatalogJanitor 22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:22,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:22,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:22,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:22,974 INFO [StoreOpener-22be79dbd2c59d446651c6f009aeee63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:22,974 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8839cd6364743d0ae1f1090faca02423, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:22,974 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101242974"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101242974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101242974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101242974"}]},"ts":"1689101242974"} 2023-07-11 18:47:22,975 DEBUG [StoreOpener-22be79dbd2c59d446651c6f009aeee63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info 2023-07-11 18:47:22,975 DEBUG [StoreOpener-22be79dbd2c59d446651c6f009aeee63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info 2023-07-11 18:47:22,975 INFO [StoreOpener-22be79dbd2c59d446651c6f009aeee63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22be79dbd2c59d446651c6f009aeee63 columnFamilyName info 2023-07-11 18:47:22,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-11 18:47:22,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; OpenRegionProcedure 8839cd6364743d0ae1f1090faca02423, server=jenkins-hbase9.apache.org,40505,1689101231800 in 196 msec 2023-07-11 18:47:22,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=49, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=8839cd6364743d0ae1f1090faca02423, ASSIGN in 357 msec 2023-07-11 18:47:22,994 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8839cd6364743d0ae1f1090faca02423#info#compaction#7 average throughput is 13.31 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:22,996 DEBUG [StoreOpener-22be79dbd2c59d446651c6f009aeee63-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54-bottom 2023-07-11 18:47:22,996 INFO [StoreOpener-22be79dbd2c59d446651c6f009aeee63-1] regionserver.HStore(310): Store=22be79dbd2c59d446651c6f009aeee63/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:22,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:23,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:23,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:23,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 22be79dbd2c59d446651c6f009aeee63; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65669771, jitterRate=-0.021444156765937805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:23,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 22be79dbd2c59d446651c6f009aeee63: 2023-07-11 18:47:23,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63., pid=55, masterSystemTime=1689101242934 2023-07-11 18:47:23,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-11 18:47:23,008 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:23,009 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:23,009 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1912): 22be79dbd2c59d446651c6f009aeee63/info is initiating minor compaction (all files) 2023-07-11 18:47:23,010 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 22be79dbd2c59d446651c6f009aeee63/info in testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:23,010 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54-bottom] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/.tmp, totalSize=606.0 K 2023-07-11 18:47:23,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:23,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:23,011 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.Compactor(207): Compacting dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c, keycount=8788, bloomtype=NONE, size=606.0 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1689101242150 2023-07-11 18:47:23,011 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=22be79dbd2c59d446651c6f009aeee63, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:23,011 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/.tmp/info/82cb42e3ff0b471d8325c8bf44538dd2 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/82cb42e3ff0b471d8325c8bf44538dd2 2023-07-11 18:47:23,011 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101243011"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101243011"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101243011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101243011"}]},"ts":"1689101243011"} 2023-07-11 18:47:23,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-11 18:47:23,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; OpenRegionProcedure 22be79dbd2c59d446651c6f009aeee63, server=jenkins-hbase9.apache.org,40505,1689101231800 in 230 msec 2023-07-11 18:47:23,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=49 2023-07-11 18:47:23,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=49, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=22be79dbd2c59d446651c6f009aeee63, ASSIGN in 393 msec 2023-07-11 18:47:23,025 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 8839cd6364743d0ae1f1090faca02423/info of 8839cd6364743d0ae1f1090faca02423 into 82cb42e3ff0b471d8325c8bf44538dd2(size=285.6 K), total size for store is 285.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:23,026 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8839cd6364743d0ae1f1090faca02423: 2023-07-11 18:47:23,026 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423., storeName=8839cd6364743d0ae1f1090faca02423/info, priority=15, startTime=1689101242959; duration=0sec 2023-07-11 18:47:23,026 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:23,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; SplitTableRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, parent=1a043584b185b695c44ad7c0f652836c, daughterA=22be79dbd2c59d446651c6f009aeee63, daughterB=8839cd6364743d0ae1f1090faca02423 in 673 msec 2023-07-11 18:47:23,035 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] throttle.PressureAwareThroughputController(145): 22be79dbd2c59d446651c6f009aeee63#info#compaction#8 average throughput is 16.87 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:23,051 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/.tmp/info/b1636f999510484da9a00512fd3a59f0 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/b1636f999510484da9a00512fd3a59f0 2023-07-11 18:47:23,059 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 22be79dbd2c59d446651c6f009aeee63/info of 22be79dbd2c59d446651c6f009aeee63 into b1636f999510484da9a00512fd3a59f0(size=325.0 K), total size for store is 325.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:23,059 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 22be79dbd2c59d446651c6f009aeee63: 2023-07-11 18:47:23,059 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63., storeName=22be79dbd2c59d446651c6f009aeee63/info, priority=15, startTime=1689101243007; duration=0sec 2023-07-11 18:47:23,059 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:23,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42667] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-07-11 18:47:23,459 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: SPLIT_REGION, Table Name: default:testMasterRestartAtRegionSplitPendingCatalogJanitor, procId: 49 completed 2023-07-11 18:47:23,459 INFO [Listener at localhost/44535] hbase.MiniHBaseCluster(607): Aborting jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:23,459 ERROR [Listener at localhost/44535] helpers.MarkerIgnoringBase(143): Master server abort: loaded coprocessors are: [org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-11 18:47:23,459 ERROR [Listener at localhost/44535] helpers.MarkerIgnoringBase(159): ***** ABORTING master jenkins-hbase9.apache.org,42667,1689101230598: Aborting for tests ***** java.lang.Exception: Trace info at org.apache.hadoop.hbase.MiniHBaseCluster.abortMaster(MiniHBaseCluster.java:608) at org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster.abortAndWaitForMaster(TestSplitTransactionOnCluster.java:999) at org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor(TestSplitTransactionOnCluster.java:723) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:23,460 INFO [Listener at localhost/44535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,42667,1689101230598' ***** 2023-07-11 18:47:23,460 INFO [Listener at localhost/44535] regionserver.HRegionServer(2311): STOPPED: Stopped by Listener at localhost/44535 2023-07-11 18:47:23,461 DEBUG [M:0;jenkins-hbase9:42667] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36b6c7f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:47:23,461 INFO [M:0;jenkins-hbase9:42667] regionserver.HRegionServer(1141): aborting server jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:23,461 DEBUG [M:0;jenkins-hbase9:42667] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cc00985 to 127.0.0.1:62848 2023-07-11 18:47:23,461 DEBUG [M:0;jenkins-hbase9:42667] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:47:23,461 INFO [M:0;jenkins-hbase9:42667] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,42667,1689101230598; all regions closed. 2023-07-11 18:47:23,461 DEBUG [M:0;jenkins-hbase9:42667] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:47:23,461 DEBUG [M:0;jenkins-hbase9:42667] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 18:47:23,462 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 18:47:23,462 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101232908] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101232908,5,FailOnTimeoutGroup] 2023-07-11 18:47:23,462 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101232910] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101232910,5,FailOnTimeoutGroup] 2023-07-11 18:47:23,462 DEBUG [M:0;jenkins-hbase9:42667] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 18:47:23,463 INFO [M:0;jenkins-hbase9:42667] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 18:47:23,463 INFO [M:0;jenkins-hbase9:42667] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 18:47:23,463 INFO [M:0;jenkins-hbase9:42667] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-11 18:47:23,464 DEBUG [M:0;jenkins-hbase9:42667] master.HMaster(1512): Stopping service threads 2023-07-11 18:47:23,464 INFO [M:0;jenkins-hbase9:42667] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 18:47:23,464 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:23,464 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:23,464 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(360): Waiting on jenkins-hbase9.apache.org,42667,1689101230598 2023-07-11 18:47:23,464 INFO [M:0;jenkins-hbase9:42667] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:47:23,464 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:23,464 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:23,464 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:23,465 ERROR [M:0;jenkins-hbase9:42667] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] 2023-07-11 18:47:23,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-07-11 18:47:23,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:23,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:23,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:23,465 INFO [M:0;jenkins-hbase9:42667] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=true 2023-07-11 18:47:23,466 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 18:47:23,466 DEBUG [M:0;jenkins-hbase9:42667] zookeeper.ZKUtil(398): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 18:47:23,466 WARN [M:0;jenkins-hbase9:42667] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 18:47:23,466 INFO [M:0;jenkins-hbase9:42667] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:47:23,466 INFO [M:0;jenkins-hbase9:42667] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=true 2023-07-11 18:47:23,471 DEBUG [M:0;jenkins-hbase9:42667] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 18:47:23,471 INFO [M:0;jenkins-hbase9:42667] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:23,471 DEBUG [M:0;jenkins-hbase9:42667] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:23,471 DEBUG [M:0;jenkins-hbase9:42667] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 18:47:23,471 DEBUG [M:0;jenkins-hbase9:42667] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:23,472 ERROR [M:0;jenkins-hbase9:42667] regionserver.HRegion(1825): Memstore data size is 214658 in region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:23,472 INFO [M:0;jenkins-hbase9:42667] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:23,472 DEBUG [M:0;jenkins-hbase9:42667] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:47:23,472 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:47:23,472 INFO [M:0;jenkins-hbase9:42667] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 18:47:23,472 INFO [M:0;jenkins-hbase9:42667] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:42667 2023-07-11 18:47:23,475 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:42667 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:42667 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:23,475 DEBUG [M:0;jenkins-hbase9:42667] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,42667,1689101230598 already deleted, retry=false 2023-07-11 18:47:23,475 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:42667 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:42667 2023-07-11 18:47:23,476 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(2738): No master found; retry 2023-07-11 18:47:23,520 WARN [RS-EventLoopGroup-7-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:42667 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:42667 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:23,521 DEBUG [RS-EventLoopGroup-7-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:42667 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:42667 2023-07-11 18:47:23,521 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(2738): No master found; retry 2023-07-11 18:47:23,522 WARN [RS-EventLoopGroup-5-1] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:42667 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:42667 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:23,522 DEBUG [RS-EventLoopGroup-5-1] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:42667 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:42667 2023-07-11 18:47:23,523 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(2738): No master found; retry 2023-07-11 18:47:23,663 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:47:23,663 INFO [M:0;jenkins-hbase9:42667] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,42667,1689101230598; zookeeper connection closed. 2023-07-11 18:47:23,663 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:42667-0x10155a8225f0000, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:47:23,678 INFO [Listener at localhost/44535] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:47:23,679 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:23,679 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:23,679 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:47:23,679 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:23,679 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:47:23,679 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:47:23,681 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39147 2023-07-11 18:47:23,682 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:23,683 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:23,684 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39147 connecting to ZooKeeper ensemble=127.0.0.1:62848 2023-07-11 18:47:23,688 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:391470x0, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:47:23,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39147-0x10155a8225f000b connected 2023-07-11 18:47:23,695 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:23,696 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/running 2023-07-11 18:47:23,697 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:47:23,697 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39147 2023-07-11 18:47:23,697 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39147 2023-07-11 18:47:23,698 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39147 2023-07-11 18:47:23,700 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39147 2023-07-11 18:47:23,700 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39147 2023-07-11 18:47:23,700 INFO [Listener at localhost/44535] master.HMaster(444): hbase.rootdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a, hbase.cluster.distributed=false 2023-07-11 18:47:23,702 DEBUG [pool-270-thread-1] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: INIT 2023-07-11 18:47:23,703 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:23,705 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 18:47:23,705 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:23,707 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:23,707 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:23,707 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:23,707 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:23,707 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:23,708 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:47:23,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:47:23,710 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,39147,1689101243678 from backup master directory 2023-07-11 18:47:23,711 INFO [M:0;jenkins-hbase9:39147] regionserver.HRegionServer(951): ClusterId : 48047c0c-16f7-44b9-ae0d-0731457ba822 2023-07-11 18:47:23,712 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:23,712 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 18:47:23,712 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:47:23,712 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:23,738 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:23,764 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0190416f to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:23,772 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54136874, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:23,772 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:23,773 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 18:47:23,773 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:47:23,780 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(288): Renamed hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598-dead as it is dead 2023-07-11 18:47:23,780 INFO [master/jenkins-hbase9:0:becomeActiveMaster] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598-dead/jenkins-hbase9.apache.org%2C42667%2C1689101230598.1689101232265 2023-07-11 18:47:23,781 INFO [master/jenkins-hbase9:0:becomeActiveMaster] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598-dead/jenkins-hbase9.apache.org%2C42667%2C1689101230598.1689101232265 after 1ms 2023-07-11 18:47:23,781 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(300): Renamed hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598-dead/jenkins-hbase9.apache.org%2C42667%2C1689101230598.1689101232265 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase9.apache.org%2C42667%2C1689101230598.1689101232265 2023-07-11 18:47:23,782 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(302): Delete empty local region wal dir hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,42667,1689101230598-dead 2023-07-11 18:47:23,782 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:23,785 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39147%2C1689101243678, suffix=, logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678, archiveDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/oldWALs, maxLogs=10 2023-07-11 18:47:23,804 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK] 2023-07-11 18:47:23,805 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK] 2023-07-11 18:47:23,808 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK] 2023-07-11 18:47:23,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678/jenkins-hbase9.apache.org%2C39147%2C1689101243678.1689101243785 2023-07-11 18:47:23,811 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK], DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK], DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK]] 2023-07-11 18:47:23,811 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:23,811 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:23,811 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:23,811 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:23,813 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:23,815 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 18:47:23,815 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 18:47:23,816 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:23,816 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5179): Found 1 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals 2023-07-11 18:47:23,816 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase9.apache.org%2C42667%2C1689101230598.1689101232265 2023-07-11 18:47:23,823 DEBUG [RS:3;jenkins-hbase9:33849] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:23,825 DEBUG [RS:2;jenkins-hbase9:40505] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:23,825 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43241, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:23,826 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:546) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15954) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:23,827 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36111, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:23,827 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:546) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15954) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:23,837 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5464): Applied 525, skipped 0, firstSequenceIdInLog=3, maxSequenceIdInLog=443, path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase9.apache.org%2C42667%2C1689101230598.1689101232265 2023-07-11 18:47:23,837 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=209.63 KB heapSize=248.71 KB 2023-07-11 18:47:23,862 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=209.63 KB at sequenceid=443 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/01a92f6468964ebcbae9325df6cd20e7 2023-07-11 18:47:23,869 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/01a92f6468964ebcbae9325df6cd20e7 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/01a92f6468964ebcbae9325df6cd20e7 2023-07-11 18:47:23,875 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/01a92f6468964ebcbae9325df6cd20e7, entries=525, sequenceid=443, filesize=215.9 K 2023-07-11 18:47:23,875 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(2948): Finished flush of dataSize ~209.63 KB/214658, heapSize ~248.70 KB/254664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 38ms, sequenceid=443, compaction requested=false; wal=null 2023-07-11 18:47:23,876 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase9.apache.org%2C42667%2C1689101230598.1689101232265 2023-07-11 18:47:23,880 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:23,882 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/443.seqid, newMaxSeqId=443, maxSeqId=1 2023-07-11 18:47:23,884 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=444; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66028219, jitterRate=-0.0161028653383255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:23,884 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:47:23,884 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 18:47:23,885 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 18:47:23,885 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 18:47:23,886 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:47:23,886 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 18:47:23,899 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:47:23,900 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:47:23,900 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:47:23,900 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:47:23,901 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:23,901 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=12, state=SUCCESS; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=ff13f8e1c63474defaefc7d45bc4b08a, daughterA=d110326d2f5fcd1365b84bd9c1da91a4, daughterB=383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:23,902 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=19, state=SUCCESS; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=383e6bcb64774cf6ef214b50782ac346, daughterA=46fcc7cc8626607b76b2955038597ba6, daughterB=613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:23,902 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=26, state=SUCCESS; DisableTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:23,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=33, state=SUCCESS; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false 2023-07-11 18:47:23,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=42, state=SUCCESS; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:23,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=43, state=SUCCESS; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:23,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=46, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, REOPEN/MOVE 2023-07-11 18:47:23,904 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=49, state=SUCCESS; SplitTableRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, parent=1a043584b185b695c44ad7c0f652836c, daughterA=22be79dbd2c59d446651c6f009aeee63, daughterB=8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:23,904 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 17 msec 2023-07-11 18:47:23,904 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 18:47:23,905 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:47:23,905 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,34803,1689101231723, table=hbase:meta, region=1588230740 2023-07-11 18:47:23,907 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 3 possibly 'live' servers, and 0 'splitting'. 2023-07-11 18:47:23,908 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:23,909 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:23,909 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:23,920 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 18:47:23,920 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 18:47:23,921 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/balancer 2023-07-11 18:47:23,921 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 18:47:23,922 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 18:47:23,923 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 18:47:23,923 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 18:47:23,924 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 18:47:23,924 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,39147,1689101243678, sessionid=0x10155a8225f000b, setting cluster-up flag (Was=true) 2023-07-11 18:47:23,926 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 18:47:23,927 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:23,929 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:546) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15954) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:23,929 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39147] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:546) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15954) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:23,929 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 18:47:23,930 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:23,931 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.hbase-snapshot/.tmp 2023-07-11 18:47:23,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:23,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:23,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:23,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:23,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-11 18:47:23,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:23,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:47:23,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:23,939 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689101273939 2023-07-11 18:47:23,939 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 18:47:23,939 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 18:47:23,939 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 18:47:23,939 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 18:47:23,939 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 18:47:23,940 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 18:47:23,940 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,941 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 18:47:23,941 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 18:47:23,941 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 18:47:23,943 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 18:47:23,943 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 18:47:23,945 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101243943,5,FailOnTimeoutGroup] 2023-07-11 18:47:23,946 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101243945,5,FailOnTimeoutGroup] 2023-07-11 18:47:23,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 18:47:23,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689101243946, completionTime=-1 2023-07-11 18:47:23,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 18:47:23,946 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:47:23,948 DEBUG [hconnection-0x7cee609a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:23,951 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=ClientService 2023-07-11 18:47:23,952 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:47:23,955 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=c3865dd83a85f157967ba62a780042b0, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,34803,1689101231723, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723, openSeqNum=2 2023-07-11 18:47:23,955 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=1a043584b185b695c44ad7c0f652836c, regionState=CLOSED, lastHost=jenkins-hbase9.apache.org,40505,1689101231800, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800, openSeqNum=5 2023-07-11 18:47:23,955 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.RegionStates(657): Added to offline, CURRENTLY NEVER CLEARED!!! state=CLOSED, location=jenkins-hbase9.apache.org,40505,1689101231800, table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:23,956 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=22be79dbd2c59d446651c6f009aeee63, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,40505,1689101231800, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800, openSeqNum=12 2023-07-11 18:47:23,956 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=8839cd6364743d0ae1f1090faca02423, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,40505,1689101231800, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800, openSeqNum=12 2023-07-11 18:47:23,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 18:47:23,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689101303956 2023-07-11 18:47:23,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689101363956 2023-07-11 18:47:23,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 10 msec 2023-07-11 18:47:23,977 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39147,1689101243678-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,977 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39147,1689101243678-BalancerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,977 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39147,1689101243678-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,977 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:39147, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,977 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:23,978 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/namespace 2023-07-11 18:47:23,978 DEBUG [RS:0;jenkins-hbase9:34803] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:23,979 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35279, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:23,991 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 18:47:23,991 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(326): Cleaning parent region {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => '', OFFLINE => true, SPLIT => true} 2023-07-11 18:47:23,995 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 18:47:23,998 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(361): Deferring removal of region {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => '', OFFLINE => true, SPLIT => true} because daughter {ENCODED => 22be79dbd2c59d446651c6f009aeee63, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.', STARTKEY => '', ENDKEY => 'nwf'} still has references 2023-07-11 18:47:23,998 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(365): Deferring removal of region {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => '', OFFLINE => true, SPLIT => true} because daughter {ENCODED => 8839cd6364743d0ae1f1090faca02423, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.', STARTKEY => 'nwf', ENDKEY => ''} still has references 2023-07-11 18:47:24,000 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 18:47:24,000 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.288sec 2023-07-11 18:47:24,000 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 18:47:24,000 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 18:47:24,000 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 18:47:24,000 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39147,1689101243678-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 18:47:24,001 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39147,1689101243678-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 18:47:24,004 INFO [Listener at localhost/44535] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 18:47:24,010 DEBUG [Listener at localhost/44535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x392999d1 to 127.0.0.1:62848 2023-07-11 18:47:24,010 DEBUG [Listener at localhost/44535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:47:24,010 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(2939): Invalidated connection. Updating master addresses before: jenkins-hbase9.apache.org:42667 after: jenkins-hbase9.apache.org:39147 2023-07-11 18:47:24,011 DEBUG [Listener at localhost/44535] zookeeper.ReadOnlyZKClient(139): Connect 0x39ca9d93 to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:24,023 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 18:47:24,033 DEBUG [Listener at localhost/44535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@718f710, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:24,034 DEBUG [Listener at localhost/44535] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:24,034 DEBUG [Listener at localhost/44535] regionserver.HStore(1912): 8839cd6364743d0ae1f1090faca02423/info is initiating major compaction (all files) 2023-07-11 18:47:24,034 INFO [Listener at localhost/44535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:47:24,034 INFO [Listener at localhost/44535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:24,035 INFO [Listener at localhost/44535] regionserver.HRegion(2259): Starting compaction of 8839cd6364743d0ae1f1090faca02423/info in testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:24,035 INFO [Listener at localhost/44535] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/82cb42e3ff0b471d8325c8bf44538dd2] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/.tmp, totalSize=285.6 K 2023-07-11 18:47:24,036 DEBUG [Listener at localhost/44535] compactions.Compactor(207): Compacting 82cb42e3ff0b471d8325c8bf44538dd2, keycount=8211, bloomtype=NONE, size=285.6 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689101242150 2023-07-11 18:47:24,063 INFO [Listener at localhost/44535] throttle.PressureAwareThroughputController(145): 8839cd6364743d0ae1f1090faca02423#info#compaction#10 average throughput is 12.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:24,091 DEBUG [Listener at localhost/44535] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/.tmp/info/b7404d8a335947a3925c1032d6e0c57b as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/b7404d8a335947a3925c1032d6e0c57b 2023-07-11 18:47:24,101 INFO [Listener at localhost/44535] regionserver.HStore(1652): Completed major compaction of 1 (all) file(s) in 8839cd6364743d0ae1f1090faca02423/info of 8839cd6364743d0ae1f1090faca02423 into b7404d8a335947a3925c1032d6e0c57b(size=285.6 K), total size for store is 285.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:24,102 DEBUG [Listener at localhost/44535] regionserver.HRegion(2289): Compaction status journal for 8839cd6364743d0ae1f1090faca02423: 2023-07-11 18:47:24,106 DEBUG [Listener at localhost/44535] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54-top, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/82cb42e3ff0b471d8325c8bf44538dd2] to archive 2023-07-11 18:47:24,107 DEBUG [Listener at localhost/44535] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:24,110 DEBUG [Listener at localhost/44535] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:24,111 DEBUG [Listener at localhost/44535] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/82cb42e3ff0b471d8325c8bf44538dd2 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/82cb42e3ff0b471d8325c8bf44538dd2 2023-07-11 18:47:24,113 DEBUG [Listener at localhost/44535] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:24,113 DEBUG [Listener at localhost/44535] regionserver.HStore(1912): 22be79dbd2c59d446651c6f009aeee63/info is initiating major compaction (all files) 2023-07-11 18:47:24,113 INFO [Listener at localhost/44535] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 18:47:24,113 INFO [Listener at localhost/44535] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:24,114 INFO [Listener at localhost/44535] regionserver.HRegion(2259): Starting compaction of 22be79dbd2c59d446651c6f009aeee63/info in testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:24,114 INFO [Listener at localhost/44535] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/b1636f999510484da9a00512fd3a59f0] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/.tmp, totalSize=325.0 K 2023-07-11 18:47:24,115 DEBUG [Listener at localhost/44535] compactions.Compactor(207): Compacting b1636f999510484da9a00512fd3a59f0, keycount=9365, bloomtype=NONE, size=325.0 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1689101242150 2023-07-11 18:47:24,146 INFO [Listener at localhost/44535] throttle.PressureAwareThroughputController(145): 22be79dbd2c59d446651c6f009aeee63#info#compaction#11 average throughput is 12.65 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:24,157 DEBUG [Listener at localhost/44535] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/.tmp/info/96ec7655b4fa460c832befde88bf622a as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/96ec7655b4fa460c832befde88bf622a 2023-07-11 18:47:24,164 INFO [Listener at localhost/44535] regionserver.HStore(1652): Completed major compaction of 1 (all) file(s) in 22be79dbd2c59d446651c6f009aeee63/info of 22be79dbd2c59d446651c6f009aeee63 into 96ec7655b4fa460c832befde88bf622a(size=325.1 K), total size for store is 325.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:24,164 DEBUG [Listener at localhost/44535] regionserver.HRegion(2289): Compaction status journal for 22be79dbd2c59d446651c6f009aeee63: 2023-07-11 18:47:24,169 DEBUG [Listener at localhost/44535] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54-bottom, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/b1636f999510484da9a00512fd3a59f0] to archive 2023-07-11 18:47:24,170 DEBUG [Listener at localhost/44535] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:24,172 DEBUG [Listener at localhost/44535] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:24,178 DEBUG [Listener at localhost/44535] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/b1636f999510484da9a00512fd3a59f0 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/b1636f999510484da9a00512fd3a59f0 2023-07-11 18:47:24,179 INFO [Listener at localhost/44535] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-07-11 18:47:24,181 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(741): Starting run of CatalogJanitor 2023-07-11 18:47:24,187 DEBUG [Listener at localhost/44535] janitor.CatalogJanitor(175): 2023-07-11 18:47:24,187 DEBUG [Listener at localhost/44535] janitor.CatalogJanitor(326): Cleaning parent region {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => '', OFFLINE => true, SPLIT => true} 2023-07-11 18:47:24,192 DEBUG [Listener at localhost/44535] janitor.CatalogJanitor(348): Deleting region 1a043584b185b695c44ad7c0f652836c because daughters -- 22be79dbd2c59d446651c6f009aeee63, 8839cd6364743d0ae1f1090faca02423 -- no longer hold references 2023-07-11 18:47:24,198 DEBUG [Listener at localhost/44535] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:GC_REGION_PREPARE; GCRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:24,198 DEBUG [Listener at localhost/44535] janitor.CatalogJanitor(355): Submitted procedure pid=56, state=RUNNABLE:GC_REGION_PREPARE; GCRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c for split parent {ENCODED => 1a043584b185b695c44ad7c0f652836c, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.', STARTKEY => '', ENDKEY => '', OFFLINE => true, SPLIT => true} 2023-07-11 18:47:24,200 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, state=RUNNABLE:GC_REGION_PREPARE; GCRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:24,203 DEBUG [PEWorker-1] assignment.GCRegionProcedure(88): Archiving region=1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:24,204 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:24,206 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits] 2023-07-11 18:47:24,213 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 2023-07-11 18:47:24,217 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits/11.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits/11.seqid 2023-07-11 18:47:24,219 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:24,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:24,224 INFO [PEWorker-1] hbase.MetaTableAccessor(1761): Deleted testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101240842.1a043584b185b695c44ad7c0f652836c. 2023-07-11 18:47:24,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; GCRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c in 32 msec 2023-07-11 18:47:24,451 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 18:47:24,453 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 18:47:24,455 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:24,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=true 2023-07-11 18:47:24,457 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(174): Tear down, remove table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,458 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 18:47:24,465 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101244465"}]},"ts":"1689101244465"} 2023-07-11 18:47:24,467 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMasterRestartAtRegionSplitPendingCatalogJanitor, state=DISABLING in hbase:meta 2023-07-11 18:47:24,468 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testMasterRestartAtRegionSplitPendingCatalogJanitor to state=DISABLING 2023-07-11 18:47:24,469 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=22be79dbd2c59d446651c6f009aeee63, UNASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=8839cd6364743d0ae1f1090faca02423, UNASSIGN}] 2023-07-11 18:47:24,471 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=8839cd6364743d0ae1f1090faca02423, UNASSIGN 2023-07-11 18:47:24,471 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=22be79dbd2c59d446651c6f009aeee63, UNASSIGN 2023-07-11 18:47:24,473 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8839cd6364743d0ae1f1090faca02423, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:24,473 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101244473"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101244473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101244473"}]},"ts":"1689101244473"} 2023-07-11 18:47:24,474 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=22be79dbd2c59d446651c6f009aeee63, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:24,474 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101244474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101244474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101244474"}]},"ts":"1689101244474"} 2023-07-11 18:47:24,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; CloseRegionProcedure 8839cd6364743d0ae1f1090faca02423, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:24,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; CloseRegionProcedure 22be79dbd2c59d446651c6f009aeee63, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:24,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 18:47:24,628 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:24,628 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:24,629 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=AdminService 2023-07-11 18:47:24,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:24,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 22be79dbd2c59d446651c6f009aeee63, disabling compactions & flushes 2023-07-11 18:47:24,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:24,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:24,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. after waiting 0 ms 2023-07-11 18:47:24,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:24,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits/16.seqid, newMaxSeqId=16, maxSeqId=11 2023-07-11 18:47:24,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63. 2023-07-11 18:47:24,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 22be79dbd2c59d446651c6f009aeee63: 2023-07-11 18:47:24,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:24,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:24,639 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8839cd6364743d0ae1f1090faca02423, disabling compactions & flushes 2023-07-11 18:47:24,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:24,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:24,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. after waiting 0 ms 2023-07-11 18:47:24,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:24,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=22be79dbd2c59d446651c6f009aeee63, regionState=CLOSED 2023-07-11 18:47:24,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101244640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101244640"}]},"ts":"1689101244640"} 2023-07-11 18:47:24,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-11 18:47:24,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; CloseRegionProcedure 22be79dbd2c59d446651c6f009aeee63, server=jenkins-hbase9.apache.org,40505,1689101231800 in 167 msec 2023-07-11 18:47:24,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits/16.seqid, newMaxSeqId=16, maxSeqId=11 2023-07-11 18:47:24,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423. 2023-07-11 18:47:24,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8839cd6364743d0ae1f1090faca02423: 2023-07-11 18:47:24,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=22be79dbd2c59d446651c6f009aeee63, UNASSIGN in 176 msec 2023-07-11 18:47:24,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:24,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8839cd6364743d0ae1f1090faca02423, regionState=CLOSED 2023-07-11 18:47:24,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.","families":{"info":[{"qualifier":"regioninfo","vlen":88,"tag":[],"timestamp":"1689101244649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101244649"}]},"ts":"1689101244649"} 2023-07-11 18:47:24,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-11 18:47:24,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; CloseRegionProcedure 8839cd6364743d0ae1f1090faca02423, server=jenkins-hbase9.apache.org,40505,1689101231800 in 176 msec 2023-07-11 18:47:24,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-11 18:47:24,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=8839cd6364743d0ae1f1090faca02423, UNASSIGN in 185 msec 2023-07-11 18:47:24,656 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101244656"}]},"ts":"1689101244656"} 2023-07-11 18:47:24,658 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMasterRestartAtRegionSplitPendingCatalogJanitor, state=DISABLED in hbase:meta 2023-07-11 18:47:24,660 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testMasterRestartAtRegionSplitPendingCatalogJanitor to state=DISABLED 2023-07-11 18:47:24,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; DisableTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor in 202 msec 2023-07-11 18:47:24,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 18:47:24,768 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testMasterRestartAtRegionSplitPendingCatalogJanitor, procId: 57 completed 2023-07-11 18:47:24,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,771 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=62, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,772 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=62, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=62 2023-07-11 18:47:24,777 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:24,777 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:24,779 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits] 2023-07-11 18:47:24,780 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits] 2023-07-11 18:47:24,783 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/96ec7655b4fa460c832befde88bf622a to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/96ec7655b4fa460c832befde88bf622a 2023-07-11 18:47:24,783 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/b7404d8a335947a3925c1032d6e0c57b to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/b7404d8a335947a3925c1032d6e0c57b 2023-07-11 18:47:24,786 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits/16.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits/16.seqid 2023-07-11 18:47:24,787 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits/16.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits/16.seqid 2023-07-11 18:47:24,787 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63 2023-07-11 18:47:24,787 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:24,788 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMasterRestartAtRegionSplitPendingCatalogJanitor regions 2023-07-11 18:47:24,790 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=62, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,793 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testMasterRestartAtRegionSplitPendingCatalogJanitor from hbase:meta 2023-07-11 18:47:24,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testMasterRestartAtRegionSplitPendingCatalogJanitor' descriptor. 2023-07-11 18:47:24,796 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=62, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,796 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testMasterRestartAtRegionSplitPendingCatalogJanitor' from region states. 2023-07-11 18:47:24,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101244796"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:24,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101244796"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:24,798 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 18:47:24,798 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 22be79dbd2c59d446651c6f009aeee63, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,,1689101242349.22be79dbd2c59d446651c6f009aeee63.', STARTKEY => '', ENDKEY => 'nwf'}, {ENCODED => 8839cd6364743d0ae1f1090faca02423, NAME => 'testMasterRestartAtRegionSplitPendingCatalogJanitor,nwf,1689101242349.8839cd6364743d0ae1f1090faca02423.', STARTKEY => 'nwf', ENDKEY => ''}] 2023-07-11 18:47:24,798 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testMasterRestartAtRegionSplitPendingCatalogJanitor' as deleted. 2023-07-11 18:47:24,798 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testMasterRestartAtRegionSplitPendingCatalogJanitor","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101244798"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:24,799 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testMasterRestartAtRegionSplitPendingCatalogJanitor state from META 2023-07-11 18:47:24,802 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=62, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:24,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; DeleteTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor in 33 msec 2023-07-11 18:47:24,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=62 2023-07-11 18:47:24,874 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testMasterRestartAtRegionSplitPendingCatalogJanitor, procId: 62 completed 2023-07-11 18:47:24,895 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testMasterRestartAtRegionSplitPendingCatalogJanitor Thread=406 (was 348) Potentially hanging thread: region-location-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase9:39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.master.assignment.AssignmentManager.waitOnAssignQueue(AssignmentManager.java:2102) org.apache.hadoop.hbase.master.assignment.AssignmentManager.processAssignQueue(AssignmentManager.java:2124) org.apache.hadoop.hbase.master.assignment.AssignmentManager.access$600(AssignmentManager.java:104) org.apache.hadoop.hbase.master.assignment.AssignmentManager$1.run(AssignmentManager.java:2064) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2022246434_17 at /127.0.0.1:37978 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:37952 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7cee609a-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:3;jenkins-hbase9:33849-longCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1159175942-172.31.2.10-1689101227463:blk_1073741869_1045, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: PacketResponder: BP-1159175942-172.31.2.10-1689101227463:blk_1073741869_1045, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=1,queue=0,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: IPC Client (934975892) connection to localhost/127.0.0.1:33811 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: region-location-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:33811 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_637172751_17 at /127.0.0.1:57074 [Receiving block BP-1159175942-172.31.2.10-1689101227463:blk_1073741869_1045] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x0190416f sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/180451019.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x0190416f-SendThread(127.0.0.1:62848) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x3b4b133b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_637172751_17 at /127.0.0.1:47714 [Receiving block BP-1159175942-172.31.2.10-1689101227463:blk_1073741869_1045] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1159175942-172.31.2.10-1689101227463:blk_1073741860_1036, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=0,queue=0,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1777286707_17 at /127.0.0.1:58474 [Receiving block BP-1159175942-172.31.2.10-1689101227463:blk_1073741860_1036] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=1,queue=0,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x39ca9d93-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x3b4b133b-SendThread(127.0.0.1:62848) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_637172751_17 at /127.0.0.1:37994 [Receiving block BP-1159175942-172.31.2.10-1689101227463:blk_1073741869_1045] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x0190416f-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:37972 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x39ca9d93-SendThread(127.0.0.1:62848) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: M:0;jenkins-hbase9:39147 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:81) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:64) org.apache.hadoop.hbase.master.HMaster.waitForMasterActive(HMaster.java:634) org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:957) org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:904) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1006) org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:541) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.metaPriority.FPBQ.Fifo.handler=0,queue=0,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:33811 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData-prefix:jenkins-hbase9.apache.org,39147,1689101243678 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x3b4b133b sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/180451019.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7cee609a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:37968 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.metaPriority.FPBQ.Fifo.handler=0,queue=0,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7cee609a-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:3;jenkins-hbase9:33849 java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:81) org.apache.hadoop.hbase.util.Sleeper.sleep(Sleeper.java:64) org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1092) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:175) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:123) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:159) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAs(Subject.java:360) org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1873) org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:319) org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:156) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7cee609a-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: AsyncFSWAL-0-hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a-prefix:jenkins-hbase9.apache.org,33849,1689101240752 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1777286707_17 at /127.0.0.1:34472 [Receiving block BP-1159175942-172.31.2.10-1689101227463:blk_1073741860_1036] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1159175942-172.31.2.10-1689101227463:blk_1073741869_1045, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:58260 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1159175942-172.31.2.10-1689101227463:blk_1073741860_1036, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:2;jenkins-hbase9:40505-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:58316 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1777286707_17 at /127.0.0.1:58412 [Receiving block BP-1159175942-172.31.2.10-1689101227463:blk_1073741860_1036] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: jenkins-hbase9:33849Replication Statistics #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101243945 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$2.run(HFileCleaner.java:251) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7cee609a-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33849 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101243943 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) org.apache.hadoop.hbase.util.StealJobQueue.take(StealJobQueue.java:101) org.apache.hadoop.hbase.master.cleaner.HFileCleaner.consumerLoop(HFileCleaner.java:267) org.apache.hadoop.hbase.master.cleaner.HFileCleaner$1.run(HFileCleaner.java:236) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait0(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:182) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:302) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:366) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62848@0x39ca9d93 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/180451019.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.getCallRunner(RpcExecutor.java:340) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=0,queue=0,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: hconnection-0x7cee609a-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:34136 [Waiting for operation #23] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7cee609a-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (934975892) connection to localhost/127.0.0.1:33811 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:47734 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcServer.replication.FPBQ.Fifo.handler=2,queue=0,port=39147 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997) java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) java.util.concurrent.Semaphore.acquire(Semaphore.java:312) org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor$FastPathHandler.getCallRunner(FastPathBalancedQueueRpcExecutor.java:105) org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Potentially hanging thread: PacketResponder: BP-1159175942-172.31.2.10-1689101227463:blk_1073741860_1036, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=768 (was 724) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 303), ProcessCount=170 (was 170), AvailableMemoryMB=7770 (was 7904) 2023-07-11 18:47:24,913 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles Thread=406, OpenFileDescriptor=768, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=170, AvailableMemoryMB=7769 2023-07-11 18:47:24,913 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:24,914 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:24,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', {NAME => 'col', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:24,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:24,919 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=63, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:24,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles" procId is: 63 2023-07-11 18:47:24,920 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=63, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:24,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=63 2023-07-11 18:47:24,922 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:24,922 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 empty. 2023-07-11 18:47:24,923 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:24,923 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles regions 2023-07-11 18:47:24,937 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:24,939 INFO [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5e64bf2fd2e5c458f152aa35d000fb1, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', {NAME => 'col', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:24,947 DEBUG [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(866): Instantiated testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:24,947 DEBUG [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(1604): Closing d5e64bf2fd2e5c458f152aa35d000fb1, disabling compactions & flushes 2023-07-11 18:47:24,947 INFO [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(1626): Closing region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:24,947 DEBUG [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:24,947 DEBUG [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. after waiting 0 ms 2023-07-11 18:47:24,947 DEBUG [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:24,947 INFO [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(1838): Closed testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:24,947 DEBUG [RegionOpenAndInit-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles-pool-0] regionserver.HRegion(1558): Region close journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:24,950 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=63, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:24,951 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":89,"tag":[],"timestamp":"1689101244950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101244950"}]},"ts":"1689101244950"} 2023-07-11 18:47:24,953 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:24,953 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=63, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:24,954 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101244953"}]},"ts":"1689101244953"} 2023-07-11 18:47:24,955 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, state=ENABLING in hbase:meta 2023-07-11 18:47:24,959 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:24,960 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:24,960 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:24,960 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:24,960 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:24,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=64, ppid=63, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=d5e64bf2fd2e5c458f152aa35d000fb1, ASSIGN}] 2023-07-11 18:47:24,965 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=64, ppid=63, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=d5e64bf2fd2e5c458f152aa35d000fb1, ASSIGN 2023-07-11 18:47:24,966 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=64, ppid=63, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=d5e64bf2fd2e5c458f152aa35d000fb1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:25,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=63 2023-07-11 18:47:25,116 INFO [jenkins-hbase9:39147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:25,117 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=64 updating hbase:meta row=d5e64bf2fd2e5c458f152aa35d000fb1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,117 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":89,"tag":[],"timestamp":"1689101245117"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101245117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101245117"}]},"ts":"1689101245117"} 2023-07-11 18:47:25,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=65, ppid=64, state=RUNNABLE; OpenRegionProcedure d5e64bf2fd2e5c458f152aa35d000fb1, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:25,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=63 2023-07-11 18:47:25,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5e64bf2fd2e5c458f152aa35d000fb1, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:25,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:25,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:25,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:25,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:25,276 INFO [StoreOpener-d5e64bf2fd2e5c458f152aa35d000fb1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family col of region d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:25,278 DEBUG [StoreOpener-d5e64bf2fd2e5c458f152aa35d000fb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col 2023-07-11 18:47:25,278 DEBUG [StoreOpener-d5e64bf2fd2e5c458f152aa35d000fb1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col 2023-07-11 18:47:25,278 INFO [StoreOpener-d5e64bf2fd2e5c458f152aa35d000fb1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5e64bf2fd2e5c458f152aa35d000fb1 columnFamilyName col 2023-07-11 18:47:25,279 INFO [StoreOpener-d5e64bf2fd2e5c458f152aa35d000fb1-1] regionserver.HStore(310): Store=d5e64bf2fd2e5c458f152aa35d000fb1/col, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:25,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:25,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:25,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:25,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:25,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d5e64bf2fd2e5c458f152aa35d000fb1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59822734, jitterRate=-0.10857179760932922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:25,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:25,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1., pid=65, masterSystemTime=1689101245271 2023-07-11 18:47:25,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,287 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=64 updating hbase:meta row=d5e64bf2fd2e5c458f152aa35d000fb1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,288 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":89,"tag":[],"timestamp":"1689101245287"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101245287"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101245287"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101245287"}]},"ts":"1689101245287"} 2023-07-11 18:47:25,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=65, resume processing ppid=64 2023-07-11 18:47:25,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, ppid=64, state=SUCCESS; OpenRegionProcedure d5e64bf2fd2e5c458f152aa35d000fb1, server=jenkins-hbase9.apache.org,40505,1689101231800 in 170 msec 2023-07-11 18:47:25,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=64, resume processing ppid=63 2023-07-11 18:47:25,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, ppid=63, state=SUCCESS; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=d5e64bf2fd2e5c458f152aa35d000fb1, ASSIGN in 330 msec 2023-07-11 18:47:25,293 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=63, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:25,293 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101245293"}]},"ts":"1689101245293"} 2023-07-11 18:47:25,294 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, state=ENABLED in hbase:meta 2023-07-11 18:47:25,296 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=63, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:25,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles in 380 msec 2023-07-11 18:47:25,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=63 2023-07-11 18:47:25,525 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, procId: 63 completed 2023-07-11 18:47:25,529 DEBUG [hconnection-0x30d957b8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:25,530 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:25,532 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:25,533 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:25,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:25,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,555 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:25,555 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,556 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:25,556 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:25,557 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,557 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,561 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,561 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,561 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,561 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,562 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,562 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,564 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,564 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,564 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,568 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,568 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,569 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,569 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,569 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,569 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,569 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,569 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,569 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,570 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,570 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,570 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,570 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,571 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:25,571 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:25,571 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,571 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:25,572 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=33 B heapSize=368 B 2023-07-11 18:47:25,572 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,574 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,574 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,574 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,574 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,574 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,587 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=33 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/c167e1d44f0944e090551070463e26a7 2023-07-11 18:47:25,592 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/c167e1d44f0944e090551070463e26a7 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c167e1d44f0944e090551070463e26a7 2023-07-11 18:47:25,598 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c167e1d44f0944e090551070463e26a7, entries=1, sequenceid=5, filesize=4.8 K 2023-07-11 18:47:25,598 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~33 B/33, heapSize ~352 B/352, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 26ms, sequenceid=5, compaction requested=false 2023-07-11 18:47:25,598 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:25,599 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:25,599 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,599 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:25,599 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:25,599 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,599 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,599 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,601 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,601 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,601 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,601 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:25,604 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:25,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46ebec02[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:25,604 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,606 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,606 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,606 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,606 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,607 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:25,607 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:25,610 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,610 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,610 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,612 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,612 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,612 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,612 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,612 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,612 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,612 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:25,617 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:25,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:25,617 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:25,617 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:25,617 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,617 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:25,619 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,619 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,619 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,619 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,619 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,619 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,620 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,620 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,620 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,621 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,624 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,624 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,625 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,635 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,635 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,635 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,635 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,636 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,636 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:25,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:25,635 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,635 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,636 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,636 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,636 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,636 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,637 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,638 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,638 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:25,638 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:25,739 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:25,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:25,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:25,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:25,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,752 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:25,752 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,753 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:25,753 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:25,753 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,753 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,755 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,755 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,755 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,755 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,755 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,755 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:25,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,757 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:25,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,757 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:25,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,758 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,758 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,759 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,760 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,760 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,760 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:25,760 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,760 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,761 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,761 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,761 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,761 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,761 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,762 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,762 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:25,762 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:25,762 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,762 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:25,763 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=27 B heapSize=360 B 2023-07-11 18:47:25,764 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,765 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,765 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,765 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,766 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,766 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,779 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=27 B at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/ba0d674e65644b9e81f477b9fc2ad703 2023-07-11 18:47:25,785 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba0d674e65644b9e81f477b9fc2ad703 2023-07-11 18:47:25,786 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/ba0d674e65644b9e81f477b9fc2ad703 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ba0d674e65644b9e81f477b9fc2ad703 2023-07-11 18:47:25,791 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba0d674e65644b9e81f477b9fc2ad703 2023-07-11 18:47:25,791 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ba0d674e65644b9e81f477b9fc2ad703, entries=1, sequenceid=9, filesize=4.9 K 2023-07-11 18:47:25,792 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~27 B/27, heapSize ~344 B/344, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 29ms, sequenceid=9, compaction requested=false 2023-07-11 18:47:25,792 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:25,792 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,792 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:25,792 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:25,792 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,792 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,792 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,794 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,794 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,794 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,794 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:25,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@482c0aaf[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:25,796 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:25,796 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,800 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,800 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,800 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,801 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,801 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,801 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:25,803 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,803 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,803 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,804 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,804 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,804 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,804 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,805 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,804 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,805 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:25,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:25,809 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:25,809 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:25,809 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:25,809 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,809 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:25,812 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,812 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,812 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,812 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,812 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,813 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,813 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,813 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,814 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,815 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,816 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,817 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,817 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:25,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:25,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,822 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:25,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,822 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,823 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,822 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:25,823 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,823 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,824 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,824 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,824 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,824 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,824 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,923 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:25,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:25,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:25,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:25,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,932 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:25,932 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,933 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:25,933 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:25,933 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,933 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,935 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,935 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,935 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,935 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,936 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,936 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,937 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,937 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:25,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,937 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:25,937 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,937 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,937 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,938 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,938 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,937 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:25,938 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,938 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,939 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,939 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:25,939 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:25,939 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,940 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:25,940 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,940 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:25,940 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:25,940 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,940 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:25,940 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=33 B heapSize=368 B 2023-07-11 18:47:25,941 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,943 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,943 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,943 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,943 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,944 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,953 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=33 B at sequenceid=13 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/d897f49f751449c282dc723b35f3748e 2023-07-11 18:47:25,959 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/d897f49f751449c282dc723b35f3748e as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/d897f49f751449c282dc723b35f3748e 2023-07-11 18:47:25,965 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/d897f49f751449c282dc723b35f3748e, entries=1, sequenceid=13, filesize=4.8 K 2023-07-11 18:47:25,966 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~33 B/33, heapSize ~352 B/352, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 26ms, sequenceid=13, compaction requested=true 2023-07-11 18:47:25,966 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:25,966 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:25,966 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:25,966 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:25,966 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,966 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:25,966 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:25,968 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,968 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,968 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,968 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:25,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c138772[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:25,971 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:25,971 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,972 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,972 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,972 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,972 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:25,972 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:25,973 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:25,972 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:25,973 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:25,974 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,974 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,974 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,974 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,974 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,975 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,976 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:25,976 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,976 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,976 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:25,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:25,980 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:25,980 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:25,980 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:25,980 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,980 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:25,985 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:25,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,985 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,985 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:25,986 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,986 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,987 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:25,988 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,989 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,989 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:25,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:25,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,992 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:25,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:25,993 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:25,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,992 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,993 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:25,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:25,994 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,994 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:25,994 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:25,994 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:25,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:25,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:25,994 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,093 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:26,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:26,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:26,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:26,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,102 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,102 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,103 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:26,103 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:26,103 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,103 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,105 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,105 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,105 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,105 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,105 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,105 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,106 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,109 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,109 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,109 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,107 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,109 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,110 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,109 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,110 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,109 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,110 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,111 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,111 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,111 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,111 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:26,111 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:26,111 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,111 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:26,111 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=27 B heapSize=360 B 2023-07-11 18:47:26,113 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,113 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,113 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,114 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,114 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,114 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,131 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=27 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/ace268f8c9604569a46924f822aee302 2023-07-11 18:47:26,136 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ace268f8c9604569a46924f822aee302 2023-07-11 18:47:26,137 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/ace268f8c9604569a46924f822aee302 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ace268f8c9604569a46924f822aee302 2023-07-11 18:47:26,142 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ace268f8c9604569a46924f822aee302 2023-07-11 18:47:26,142 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ace268f8c9604569a46924f822aee302, entries=1, sequenceid=17, filesize=4.9 K 2023-07-11 18:47:26,143 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~27 B/27, heapSize ~344 B/344, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 32ms, sequenceid=17, compaction requested=true 2023-07-11 18:47:26,143 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:26,143 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,143 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:26,143 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:26,143 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,143 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,143 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,145 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,145 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,145 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,145 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:26,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9110094[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:26,147 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:26,147 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,148 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,148 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,148 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,149 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,149 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:26,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,149 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:26,152 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,152 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,152 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,153 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,153 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,153 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,153 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,153 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,153 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,153 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:26,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:26,160 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:26,160 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:26,160 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:26,160 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,160 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:26,162 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,162 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,162 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,162 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,162 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,163 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,164 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,164 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,166 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,166 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,167 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,173 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,173 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:26,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,174 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:26,174 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,174 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,174 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,174 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,174 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,274 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:26,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:26,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:26,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:26,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,283 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,283 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,284 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:26,284 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:26,284 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,284 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,286 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,287 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,288 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,288 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,288 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,288 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,288 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,288 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,288 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,288 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,288 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,289 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,288 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,289 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,291 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,291 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,289 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,291 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,291 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,291 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:26,291 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:26,291 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,291 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:26,292 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=33 B heapSize=368 B 2023-07-11 18:47:26,293 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,293 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,293 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,294 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,294 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,294 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,302 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=33 B at sequenceid=21 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/82077d9e77be4aa9a3936de33fca5b85 2023-07-11 18:47:26,308 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/82077d9e77be4aa9a3936de33fca5b85 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/82077d9e77be4aa9a3936de33fca5b85 2023-07-11 18:47:26,313 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/82077d9e77be4aa9a3936de33fca5b85, entries=1, sequenceid=21, filesize=4.8 K 2023-07-11 18:47:26,314 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~33 B/33, heapSize ~352 B/352, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 22ms, sequenceid=21, compaction requested=true 2023-07-11 18:47:26,314 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:26,314 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,314 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:26,315 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:26,315 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,315 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,315 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,318 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,318 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,318 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,318 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:26,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10037648[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:26,320 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:26,320 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,321 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,321 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,321 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,322 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,322 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:26,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,322 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:26,323 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,324 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,324 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,325 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,325 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,325 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,325 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,327 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,327 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,327 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:26,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:26,331 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:26,331 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:26,331 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:26,331 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,331 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:26,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,333 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,334 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,334 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,336 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,336 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,337 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:26,339 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,339 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,340 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,341 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,341 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:26,340 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,340 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,341 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,341 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,341 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,341 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,441 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:26,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:26,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:26,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:26,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,449 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,450 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,451 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:26,451 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:26,451 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,451 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,453 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,453 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,453 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,453 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,454 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,454 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,455 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,455 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,455 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,455 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,461 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,462 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,462 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,462 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,462 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,463 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,463 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,463 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:26,463 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,463 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,464 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,464 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:26,463 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:26,464 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,464 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=27 B heapSize=360 B 2023-07-11 18:47:26,466 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,470 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,470 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,470 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,470 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,470 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,480 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=27 B at sequenceid=25 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/479e3ad5bee6454597090224a4832898 2023-07-11 18:47:26,485 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 479e3ad5bee6454597090224a4832898 2023-07-11 18:47:26,486 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/479e3ad5bee6454597090224a4832898 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/479e3ad5bee6454597090224a4832898 2023-07-11 18:47:26,491 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 479e3ad5bee6454597090224a4832898 2023-07-11 18:47:26,491 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/479e3ad5bee6454597090224a4832898, entries=1, sequenceid=25, filesize=4.9 K 2023-07-11 18:47:26,492 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~27 B/27, heapSize ~344 B/344, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 28ms, sequenceid=25, compaction requested=true 2023-07-11 18:47:26,492 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:26,492 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,492 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:26,492 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:26,492 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,492 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,492 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,494 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,494 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,494 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,494 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:26,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38526f95[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:26,497 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:26,497 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,498 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,498 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,498 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,499 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:26,499 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,499 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:26,502 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,502 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,502 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,502 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,503 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,503 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,503 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,504 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,504 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,504 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:26,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:26,508 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:26,509 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:26,509 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:26,509 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,509 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:26,510 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,510 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,510 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,510 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,511 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,511 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,512 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,513 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,515 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,515 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,516 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,520 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:26,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:26,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,521 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:26,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,622 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:26,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:26,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:26,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:26,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,629 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,629 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,630 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:26,630 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:26,631 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,631 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,633 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,633 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,633 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,633 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,634 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,634 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:26,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,635 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,635 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,635 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,635 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,636 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,636 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,636 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,636 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,637 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,637 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,636 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,637 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,637 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,637 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:26,638 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:26,637 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,638 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,637 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,638 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,638 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:26,638 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,638 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=33 B heapSize=368 B 2023-07-11 18:47:26,639 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,640 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,640 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,640 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,641 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,641 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,651 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=33 B at sequenceid=29 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/e4f5758207d34fae83be9bec50400aee 2023-07-11 18:47:26,657 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/e4f5758207d34fae83be9bec50400aee as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/e4f5758207d34fae83be9bec50400aee 2023-07-11 18:47:26,662 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/e4f5758207d34fae83be9bec50400aee, entries=1, sequenceid=29, filesize=4.8 K 2023-07-11 18:47:26,663 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~33 B/33, heapSize ~352 B/352, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 25ms, sequenceid=29, compaction requested=true 2023-07-11 18:47:26,663 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:26,663 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,663 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:26,663 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:26,663 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,663 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,663 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,665 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,665 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,665 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,665 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:26,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68aa47fa[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:26,667 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:26,667 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,670 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:26,670 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:26,670 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:26,674 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,674 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,674 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,674 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,675 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,675 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,676 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,676 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,676 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,676 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:26,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:26,680 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:26,680 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:26,680 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:26,680 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,680 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:26,682 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,682 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,682 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,682 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,682 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,683 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,683 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,685 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,685 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,686 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,690 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,691 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,690 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:26,691 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,691 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,692 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:26,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,692 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:26,692 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,792 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:26,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:26,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:26,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:26,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,800 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,800 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,801 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:26,801 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:26,802 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,802 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,803 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,803 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,803 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,803 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,805 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,805 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,805 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,805 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,805 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,805 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,805 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,806 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,806 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,806 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,805 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,806 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,806 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,807 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,806 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,807 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,807 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,807 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,807 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:26,807 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:26,807 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,807 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:26,808 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=27 B heapSize=360 B 2023-07-11 18:47:26,809 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,809 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,809 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,809 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,809 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,809 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,819 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=27 B at sequenceid=33 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/af5e63ac1bf7443da10d7570ed15c5ff 2023-07-11 18:47:26,824 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af5e63ac1bf7443da10d7570ed15c5ff 2023-07-11 18:47:26,825 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/af5e63ac1bf7443da10d7570ed15c5ff as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/af5e63ac1bf7443da10d7570ed15c5ff 2023-07-11 18:47:26,830 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af5e63ac1bf7443da10d7570ed15c5ff 2023-07-11 18:47:26,830 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/af5e63ac1bf7443da10d7570ed15c5ff, entries=1, sequenceid=33, filesize=4.9 K 2023-07-11 18:47:26,831 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~27 B/27, heapSize ~344 B/344, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 23ms, sequenceid=33, compaction requested=true 2023-07-11 18:47:26,831 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:26,831 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,831 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:26,831 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:26,831 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,831 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,831 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,832 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,833 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,833 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,833 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:26,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@693effdb[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:26,835 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:26,835 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,837 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,837 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,837 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,838 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,838 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:26,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:26,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:26,838 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:26,839 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,839 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,839 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,840 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,841 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,841 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:26,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,841 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,841 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,841 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,842 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:26,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:26,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:26,845 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:26,845 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:26,845 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:26,845 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,846 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:26,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:26,847 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,849 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,849 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:26,850 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:26,852 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,852 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,853 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:26,860 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:26,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,861 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,861 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:26,861 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:26,860 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:26,862 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,862 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:26,862 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:26,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:26,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:26,962 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:26,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:26,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:26,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,970 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:26,970 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,971 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:26,971 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:26,972 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,972 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,973 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,973 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,973 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,973 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:26,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:26,973 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:26,973 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,974 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:26,975 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,975 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,975 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,977 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,977 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,977 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,978 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,978 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,978 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,978 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,978 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:26,978 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:26,978 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:26,978 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:26,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,978 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:26,978 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:26,979 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:26,979 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=33 B heapSize=368 B 2023-07-11 18:47:26,979 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:26,979 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:26,979 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:26,980 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,981 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,981 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,981 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,982 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:26,982 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:26,990 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=33 B at sequenceid=37 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/8bd255be04e549da827960e877aeb20f 2023-07-11 18:47:26,996 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/8bd255be04e549da827960e877aeb20f as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/8bd255be04e549da827960e877aeb20f 2023-07-11 18:47:27,001 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/8bd255be04e549da827960e877aeb20f, entries=1, sequenceid=37, filesize=4.8 K 2023-07-11 18:47:27,002 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~33 B/33, heapSize ~352 B/352, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 23ms, sequenceid=37, compaction requested=true 2023-07-11 18:47:27,002 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:27,002 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,002 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:27,002 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:27,002 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,002 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,002 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,005 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,005 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,005 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,005 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:27,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62046582[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:27,007 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:27,007 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,008 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,008 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,008 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,009 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,009 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:27,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:27,009 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:27,011 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,011 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,011 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,011 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,012 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,012 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,012 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,012 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,012 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,013 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:27,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:27,017 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:27,017 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:27,017 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:27,017 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,017 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:27,022 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,022 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,022 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,022 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,023 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,023 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,024 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,025 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,026 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,026 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,028 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,028 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,028 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,028 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,029 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,028 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:27,029 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,029 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,029 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,028 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,031 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,029 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,031 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:27,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,032 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,032 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,032 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,032 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,032 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,032 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,032 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,132 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:27,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:27,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:27,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:27,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,139 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,140 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,140 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:27,140 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:27,141 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,141 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,145 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,145 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,145 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,145 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,145 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,145 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,146 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,147 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,147 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,147 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,148 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,148 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,148 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,148 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:27,148 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:27,148 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,148 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,148 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:27,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,149 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=27 B heapSize=360 B 2023-07-11 18:47:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,149 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,151 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,151 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,151 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,151 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,154 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,154 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,154 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,154 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,154 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,154 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,161 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=27 B at sequenceid=41 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/25464e50e9fa41249a2adc6f11771828 2023-07-11 18:47:27,167 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25464e50e9fa41249a2adc6f11771828 2023-07-11 18:47:27,168 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/25464e50e9fa41249a2adc6f11771828 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/25464e50e9fa41249a2adc6f11771828 2023-07-11 18:47:27,172 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 25464e50e9fa41249a2adc6f11771828 2023-07-11 18:47:27,173 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/25464e50e9fa41249a2adc6f11771828, entries=1, sequenceid=41, filesize=4.9 K 2023-07-11 18:47:27,173 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~27 B/27, heapSize ~344 B/344, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 24ms, sequenceid=41, compaction requested=true 2023-07-11 18:47:27,173 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:27,173 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,174 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:27,174 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:27,174 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,174 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,174 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,175 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,175 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,176 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,176 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:27,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49018090[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:27,177 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:27,178 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,179 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,179 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,179 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,179 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,179 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,179 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:27,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,179 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:27,179 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,179 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,179 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:27,181 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,181 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,181 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,181 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,181 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,181 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,181 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:27,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:27,185 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:27,185 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:27,185 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:27,185 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,185 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:27,187 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,187 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,187 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,187 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,187 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,188 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,189 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,189 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,190 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,190 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,190 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,190 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,192 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,192 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,192 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,192 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,192 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,193 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,197 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,197 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,197 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,197 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,197 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,197 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:27,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,197 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,197 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,198 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,198 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,198 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,198 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,198 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,198 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,198 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,198 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:27,199 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,199 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:27,199 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,199 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,299 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:27,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:27,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,307 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,307 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,307 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:27,307 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:27,308 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,308 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,309 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,309 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,309 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,309 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,310 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,310 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,311 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,311 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,311 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,311 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,311 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,311 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,311 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,312 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,312 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,311 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,312 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,312 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,312 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,312 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:27,312 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:27,312 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,312 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:27,312 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=33 B heapSize=368 B 2023-07-11 18:47:27,314 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,314 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,315 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,315 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,315 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,315 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,329 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=33 B at sequenceid=45 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/c3f69e0b68e94f4bb3d4fe55791c839d 2023-07-11 18:47:27,335 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/c3f69e0b68e94f4bb3d4fe55791c839d as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c3f69e0b68e94f4bb3d4fe55791c839d 2023-07-11 18:47:27,341 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c3f69e0b68e94f4bb3d4fe55791c839d, entries=1, sequenceid=45, filesize=4.8 K 2023-07-11 18:47:27,342 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~33 B/33, heapSize ~352 B/352, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 30ms, sequenceid=45, compaction requested=true 2023-07-11 18:47:27,342 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:27,342 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,342 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:27,342 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:27,342 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,342 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,342 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,344 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,344 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,344 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,344 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:27,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73ae8bdd[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:27,346 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:27,346 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,347 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,347 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:27,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,347 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,347 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,348 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,348 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:27,347 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:27,347 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,348 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:27,355 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,355 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,355 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,355 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,355 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,355 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,356 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,356 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,356 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:27,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:27,359 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:27,359 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:27,359 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:27,359 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,359 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:27,361 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,361 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,361 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,361 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,362 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,362 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,364 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,365 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,365 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,368 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:27,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:27,368 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,369 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,469 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:27,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:27,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:27,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:27,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,476 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,476 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,476 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:27,476 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:27,477 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,477 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,479 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,479 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,479 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,479 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,480 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,480 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,489 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,490 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,490 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,490 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,491 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:27,491 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:27,491 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,491 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:27,491 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=27 B heapSize=360 B 2023-07-11 18:47:27,492 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,492 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,493 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,494 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,494 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,494 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,502 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=27 B at sequenceid=49 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/03a785c75f504434b0a4a8935ba4db56 2023-07-11 18:47:27,507 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03a785c75f504434b0a4a8935ba4db56 2023-07-11 18:47:27,508 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/03a785c75f504434b0a4a8935ba4db56 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/03a785c75f504434b0a4a8935ba4db56 2023-07-11 18:47:27,513 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03a785c75f504434b0a4a8935ba4db56 2023-07-11 18:47:27,513 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/03a785c75f504434b0a4a8935ba4db56, entries=1, sequenceid=49, filesize=4.9 K 2023-07-11 18:47:27,514 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~27 B/27, heapSize ~344 B/344, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 23ms, sequenceid=49, compaction requested=true 2023-07-11 18:47:27,514 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:27,514 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,514 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:27,514 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:27,514 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,514 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,514 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,516 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,516 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,516 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,516 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:27,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d706254[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:27,518 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:27,518 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,519 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,519 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,519 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,519 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:27,520 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,520 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,519 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,520 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:27,520 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:27,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,520 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,520 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,520 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:27,522 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,522 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,522 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,523 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,523 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,523 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,523 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,524 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,524 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,524 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:27,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:27,527 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:27,527 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:27,527 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:27,527 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,527 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:27,529 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,529 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,529 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,529 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,530 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,530 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,532 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,532 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,533 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:27,539 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,540 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:27,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,540 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:27,539 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,540 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,540 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,540 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,540 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,540 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,540 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,640 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:27,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:27,650 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:27,652 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:47:27,652 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40505] regionserver.RSRpcServices(1662): Compacting testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,653 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40505] compactions.SortedCompactionPolicy(75): Selecting compaction from 12 store files, 0 compacting, 12 eligible, 16 blocking 2023-07-11 18:47:27,653 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40505] compactions.SortedCompactionPolicy(214): Warning, compacting more than 10 files because of a user-requested major compaction 2023-07-11 18:47:27,653 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40505] regionserver.HStore(1912): d5e64bf2fd2e5c458f152aa35d000fb1/col is initiating major compaction (all files) 2023-07-11 18:47:27,653 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40505] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1fc88953; Because: User-triggered major compaction for region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:27,653 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d5e64bf2fd2e5c458f152aa35d000fb1/col in testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,654 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c167e1d44f0944e090551070463e26a7, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ba0d674e65644b9e81f477b9fc2ad703, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/d897f49f751449c282dc723b35f3748e, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ace268f8c9604569a46924f822aee302, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/82077d9e77be4aa9a3936de33fca5b85, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/479e3ad5bee6454597090224a4832898, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/e4f5758207d34fae83be9bec50400aee, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/af5e63ac1bf7443da10d7570ed15c5ff, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/8bd255be04e549da827960e877aeb20f, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/25464e50e9fa41249a2adc6f11771828, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c3f69e0b68e94f4bb3d4fe55791c839d, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/03a785c75f504434b0a4a8935ba4db56] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp, totalSize=57.8 K 2023-07-11 18:47:27,654 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting c167e1d44f0944e090551070463e26a7, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1689101245534 2023-07-11 18:47:27,655 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting ba0d674e65644b9e81f477b9fc2ad703, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=9223372036854775807 2023-07-11 18:47:27,655 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting d897f49f751449c282dc723b35f3748e, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1689101245925 2023-07-11 18:47:27,656 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting ace268f8c9604569a46924f822aee302, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=9223372036854775807 2023-07-11 18:47:27,656 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting 82077d9e77be4aa9a3936de33fca5b85, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=21, earliestPutTs=1689101246276 2023-07-11 18:47:27,657 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting 479e3ad5bee6454597090224a4832898, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25, earliestPutTs=9223372036854775807 2023-07-11 18:47:27,657 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting e4f5758207d34fae83be9bec50400aee, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=29, earliestPutTs=1689101246623 2023-07-11 18:47:27,658 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting af5e63ac1bf7443da10d7570ed15c5ff, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33, earliestPutTs=9223372036854775807 2023-07-11 18:47:27,658 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting 8bd255be04e549da827960e877aeb20f, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=37, earliestPutTs=1689101246964 2023-07-11 18:47:27,659 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting 25464e50e9fa41249a2adc6f11771828, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41, earliestPutTs=9223372036854775807 2023-07-11 18:47:27,659 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting c3f69e0b68e94f4bb3d4fe55791c839d, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1689101247301 2023-07-11 18:47:27,660 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting 03a785c75f504434b0a4a8935ba4db56, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=49, earliestPutTs=9223372036854775807 2023-07-11 18:47:27,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:27,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:27,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,664 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,664 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,664 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' 2023-07-11 18:47:27,664 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', kicking off acquire phase on members. 2023-07-11 18:47:27,664 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,664 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,666 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,666 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,666 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,666 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,666 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,666 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,667 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,667 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,667 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,668 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:27,668 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,668 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,668 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,668 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,668 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:27,669 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles is still present, removing 2023-07-11 18:47:27,669 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,669 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. started... 2023-07-11 18:47:27,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,669 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d5e64bf2fd2e5c458f152aa35d000fb1 1/1 column families, dataSize=96 B heapSize=568 B 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' with timeout 60000ms 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'acquire' stage 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,669 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:27,671 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,671 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,671 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,673 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,673 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,673 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,683 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=96 B at sequenceid=55 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/63a09604fe7343d69e9fa7bc7654ad80 2023-07-11 18:47:27,696 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/63a09604fe7343d69e9fa7bc7654ad80 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80 2023-07-11 18:47:27,705 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] throttle.PressureAwareThroughputController(145): d5e64bf2fd2e5c458f152aa35d000fb1#col#compaction#25 average throughput is 0.00 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:27,706 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80, entries=3, sequenceid=55, filesize=4.8 K 2023-07-11 18:47:27,707 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~96 B/96, heapSize ~552 B/552, currentSize=0 B/0 for d5e64bf2fd2e5c458f152aa35d000fb1 in 38ms, sequenceid=55, compaction requested=false 2023-07-11 18:47:27,707 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:27,707 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,708 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:27,708 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:27,708 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,708 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally acquired 2023-07-11 18:47:27,708 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles) in zk 2023-07-11 18:47:27,711 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,711 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,711 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,711 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' on coordinator 2023-07-11 18:47:27,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c19320d[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:27,714 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' starting 'in-barrier' execution. 2023-07-11 18:47:27,714 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,715 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,715 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,715 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,715 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,715 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,715 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:27,715 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,716 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:27,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,716 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,716 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' received 'reached' from coordinator. 2023-07-11 18:47:27,716 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,716 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:27,716 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' locally completed 2023-07-11 18:47:27,716 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:27,717 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,717 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,717 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,718 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,718 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,718 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,718 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' has notified controller of completion 2023-07-11 18:47:27,718 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,719 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,719 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' completed. 2023-07-11 18:47:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,719 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStoreFile(437): HFile Bloom filter type for 43308d3e9e75477c8b7911ffffe6a993: NONE, but ROW specified in column family configuration 2023-07-11 18:47:27,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,720 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/.tmp/col/43308d3e9e75477c8b7911ffffe6a993 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/43308d3e9e75477c8b7911ffffe6a993 2023-07-11 18:47:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:27,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles', counting down latch. Waiting for 0 more 2023-07-11 18:47:27,723 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' execution completed 2023-07-11 18:47:27,723 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:27,723 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:27,723 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,723 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:27,725 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStoreFile(437): HFile Bloom filter type for 43308d3e9e75477c8b7911ffffe6a993: NONE, but ROW specified in column family configuration 2023-07-11 18:47:27,726 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:27,726 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:27,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,726 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,726 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,727 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,728 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:27,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,730 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,730 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1652): Completed major compaction of 12 (all) file(s) in d5e64bf2fd2e5c458f152aa35d000fb1/col of d5e64bf2fd2e5c458f152aa35d000fb1 into 43308d3e9e75477c8b7911ffffe6a993(size=4.8 K), total size for store is 9.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:27,730 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,731 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1., storeName=col, fileCount=12, fileSize=57.8 K (4.8 K, 4.9 K, 4.8 K, 4.9 K, 4.8 K, 4.9 K, 4.8 K, 4.9 K, 4.8 K, 4.9 K, 4.8 K, 4.9 K), priority=1, time=1689101247653; duration=0sec 2023-07-11 18:47:27,731 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:27,731 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,732 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,732 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,740 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,739 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:27,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:27,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' 2023-07-11 18:47:27,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,740 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:27,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:27,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,741 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:27,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:27,741 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,741 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:27,841 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:27,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:27,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:27,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, parent=d5e64bf2fd2e5c458f152aa35d000fb1, daughterA=9a6461924e1cac9cba18e02dc09c9189, daughterB=3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:27,847 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=66, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, parent=d5e64bf2fd2e5c458f152aa35d000fb1, daughterA=9a6461924e1cac9cba18e02dc09c9189, daughterB=3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:27,847 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=66, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, parent=d5e64bf2fd2e5c458f152aa35d000fb1, daughterA=9a6461924e1cac9cba18e02dc09c9189, daughterB=3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:27,847 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=66, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, parent=d5e64bf2fd2e5c458f152aa35d000fb1, daughterA=9a6461924e1cac9cba18e02dc09c9189, daughterB=3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:27,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=d5e64bf2fd2e5c458f152aa35d000fb1, UNASSIGN}] 2023-07-11 18:47:27,851 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=d5e64bf2fd2e5c458f152aa35d000fb1, UNASSIGN 2023-07-11 18:47:27,851 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d5e64bf2fd2e5c458f152aa35d000fb1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:27,852 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":89,"tag":[],"timestamp":"1689101247851"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101247851"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101247851"}]},"ts":"1689101247851"} 2023-07-11 18:47:27,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure d5e64bf2fd2e5c458f152aa35d000fb1, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:28,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:28,005 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d5e64bf2fd2e5c458f152aa35d000fb1, disabling compactions & flushes 2023-07-11 18:47:28,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:28,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:28,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. after waiting 0 ms 2023-07-11 18:47:28,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:28,025 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c167e1d44f0944e090551070463e26a7, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ba0d674e65644b9e81f477b9fc2ad703, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/d897f49f751449c282dc723b35f3748e, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ace268f8c9604569a46924f822aee302, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/82077d9e77be4aa9a3936de33fca5b85, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/479e3ad5bee6454597090224a4832898, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/e4f5758207d34fae83be9bec50400aee, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/af5e63ac1bf7443da10d7570ed15c5ff, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/8bd255be04e549da827960e877aeb20f, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/25464e50e9fa41249a2adc6f11771828, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c3f69e0b68e94f4bb3d4fe55791c839d, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/03a785c75f504434b0a4a8935ba4db56] to archive 2023-07-11 18:47:28,026 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:28,028 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c167e1d44f0944e090551070463e26a7 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c167e1d44f0944e090551070463e26a7 2023-07-11 18:47:28,029 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ba0d674e65644b9e81f477b9fc2ad703 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ba0d674e65644b9e81f477b9fc2ad703 2023-07-11 18:47:28,030 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/d897f49f751449c282dc723b35f3748e to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/d897f49f751449c282dc723b35f3748e 2023-07-11 18:47:28,031 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ace268f8c9604569a46924f822aee302 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ace268f8c9604569a46924f822aee302 2023-07-11 18:47:28,033 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/82077d9e77be4aa9a3936de33fca5b85 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/82077d9e77be4aa9a3936de33fca5b85 2023-07-11 18:47:28,034 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/479e3ad5bee6454597090224a4832898 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/479e3ad5bee6454597090224a4832898 2023-07-11 18:47:28,035 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/e4f5758207d34fae83be9bec50400aee to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/e4f5758207d34fae83be9bec50400aee 2023-07-11 18:47:28,036 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/af5e63ac1bf7443da10d7570ed15c5ff to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/af5e63ac1bf7443da10d7570ed15c5ff 2023-07-11 18:47:28,038 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/8bd255be04e549da827960e877aeb20f to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/8bd255be04e549da827960e877aeb20f 2023-07-11 18:47:28,039 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/25464e50e9fa41249a2adc6f11771828 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/25464e50e9fa41249a2adc6f11771828 2023-07-11 18:47:28,041 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c3f69e0b68e94f4bb3d4fe55791c839d to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c3f69e0b68e94f4bb3d4fe55791c839d 2023-07-11 18:47:28,042 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/03a785c75f504434b0a4a8935ba4db56 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/03a785c75f504434b0a4a8935ba4db56 2023-07-11 18:47:28,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits/59.seqid, newMaxSeqId=59, maxSeqId=1 2023-07-11 18:47:28,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. 2023-07-11 18:47:28,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d5e64bf2fd2e5c458f152aa35d000fb1: 2023-07-11 18:47:28,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:28,052 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d5e64bf2fd2e5c458f152aa35d000fb1, regionState=CLOSED 2023-07-11 18:47:28,052 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":89,"tag":[],"timestamp":"1689101248052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101248052"}]},"ts":"1689101248052"} 2023-07-11 18:47:28,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-07-11 18:47:28,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure d5e64bf2fd2e5c458f152aa35d000fb1, server=jenkins-hbase9.apache.org,40505,1689101231800 in 200 msec 2023-07-11 18:47:28,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-11 18:47:28,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=d5e64bf2fd2e5c458f152aa35d000fb1, UNASSIGN in 206 msec 2023-07-11 18:47:28,064 INFO [PEWorker-5] assignment.SplitTableRegionProcedure(694): pid=66 splitting 2 storefiles, region=d5e64bf2fd2e5c458f152aa35d000fb1, threads=2 2023-07-11 18:47:28,065 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=66 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/43308d3e9e75477c8b7911ffffe6a993 for region: d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:28,065 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=66 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80 for region: d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:28,069 DEBUG [StoreFileSplitter-pool-0] regionserver.HStoreFile(437): HFile Bloom filter type for 43308d3e9e75477c8b7911ffffe6a993: NONE, but ROW specified in column family configuration 2023-07-11 18:47:28,074 DEBUG [StoreFileSplitter-pool-0] regionserver.HStoreFile(437): HFile Bloom filter type for 43308d3e9e75477c8b7911ffffe6a993: NONE, but ROW specified in column family configuration 2023-07-11 18:47:28,074 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=66 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/43308d3e9e75477c8b7911ffffe6a993 for region: d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:28,091 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=66 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80 for region: d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:28,091 DEBUG [PEWorker-5] assignment.SplitTableRegionProcedure(755): pid=66 split storefiles for region d5e64bf2fd2e5c458f152aa35d000fb1 Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:28,121 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits/59.seqid, newMaxSeqId=59, maxSeqId=-1 2023-07-11 18:47:28,123 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits/59.seqid, newMaxSeqId=59, maxSeqId=-1 2023-07-11 18:47:28,125 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.","families":{"info":[{"qualifier":"regioninfo","vlen":89,"tag":[],"timestamp":"1689101248125"},{"qualifier":"splitA","vlen":93,"tag":[],"timestamp":"1689101248125"},{"qualifier":"splitB","vlen":93,"tag":[],"timestamp":"1689101248125"}]},"ts":"1689101248125"} 2023-07-11 18:47:28,125 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101248125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101248125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101248125"}]},"ts":"1689101248125"} 2023-07-11 18:47:28,125 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101248125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101248125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101248125"}]},"ts":"1689101248125"} 2023-07-11 18:47:28,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=9a6461924e1cac9cba18e02dc09c9189, ASSIGN}, {pid=70, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=3a1940ecd93b7c6a3b196c97cadecbb6, ASSIGN}] 2023-07-11 18:47:28,129 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=70, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=3a1940ecd93b7c6a3b196c97cadecbb6, ASSIGN 2023-07-11 18:47:28,129 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=69, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=9a6461924e1cac9cba18e02dc09c9189, ASSIGN 2023-07-11 18:47:28,130 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=70, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=3a1940ecd93b7c6a3b196c97cadecbb6, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:28,130 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=69, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=9a6461924e1cac9cba18e02dc09c9189, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:28,280 INFO [jenkins-hbase9:39147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:28,282 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=9a6461924e1cac9cba18e02dc09c9189, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:28,282 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=3a1940ecd93b7c6a3b196c97cadecbb6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:28,282 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101248282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101248282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101248282"}]},"ts":"1689101248282"} 2023-07-11 18:47:28,282 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101248282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101248282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101248282"}]},"ts":"1689101248282"} 2023-07-11 18:47:28,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=71, ppid=69, state=RUNNABLE; OpenRegionProcedure 9a6461924e1cac9cba18e02dc09c9189, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:28,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=70, state=RUNNABLE; OpenRegionProcedure 3a1940ecd93b7c6a3b196c97cadecbb6, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:28,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:28,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a6461924e1cac9cba18e02dc09c9189, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.', STARTKEY => '', ENDKEY => 'row7'} 2023-07-11 18:47:28,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:28,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:28,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:28,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:28,440 INFO [StoreOpener-9a6461924e1cac9cba18e02dc09c9189-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family col of region 9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:28,441 DEBUG [StoreOpener-9a6461924e1cac9cba18e02dc09c9189-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col 2023-07-11 18:47:28,441 DEBUG [StoreOpener-9a6461924e1cac9cba18e02dc09c9189-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col 2023-07-11 18:47:28,442 INFO [StoreOpener-9a6461924e1cac9cba18e02dc09c9189-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a6461924e1cac9cba18e02dc09c9189 columnFamilyName col 2023-07-11 18:47:28,450 DEBUG [StoreOpener-9a6461924e1cac9cba18e02dc09c9189-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80-bottom 2023-07-11 18:47:28,450 INFO [StoreOpener-9a6461924e1cac9cba18e02dc09c9189-1] regionserver.HStore(310): Store=9a6461924e1cac9cba18e02dc09c9189/col, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:28,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:28,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:28,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:28,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9a6461924e1cac9cba18e02dc09c9189; next sequenceid=60; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60875281, jitterRate=-0.09288762509822845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:28,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9a6461924e1cac9cba18e02dc09c9189: 2023-07-11 18:47:28,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189., pid=71, masterSystemTime=1689101248435 2023-07-11 18:47:28,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:28,457 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:28,457 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF col since it belongs to recently split daughter region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:28,457 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1912): 9a6461924e1cac9cba18e02dc09c9189/col is initiating minor compaction (all files) 2023-07-11 18:47:28,457 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9a6461924e1cac9cba18e02dc09c9189/col in testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:28,458 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80-bottom] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/.tmp, totalSize=4.8 K 2023-07-11 18:47:28,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:28,458 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting 63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=55, earliestPutTs=1689101247655 2023-07-11 18:47:28,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:28,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:28,458 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=69 updating hbase:meta row=9a6461924e1cac9cba18e02dc09c9189, regionState=OPEN, openSeqNum=60, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:28,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a1940ecd93b7c6a3b196c97cadecbb6, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.', STARTKEY => 'row7', ENDKEY => ''} 2023-07-11 18:47:28,459 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101248458"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101248458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101248458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101248458"}]},"ts":"1689101248458"} 2023-07-11 18:47:28,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:28,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:28,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:28,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:28,460 INFO [StoreOpener-3a1940ecd93b7c6a3b196c97cadecbb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family col of region 3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:28,461 DEBUG [StoreOpener-3a1940ecd93b7c6a3b196c97cadecbb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col 2023-07-11 18:47:28,461 DEBUG [StoreOpener-3a1940ecd93b7c6a3b196c97cadecbb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col 2023-07-11 18:47:28,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=71, resume processing ppid=69 2023-07-11 18:47:28,462 INFO [StoreOpener-3a1940ecd93b7c6a3b196c97cadecbb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1940ecd93b7c6a3b196c97cadecbb6 columnFamilyName col 2023-07-11 18:47:28,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, ppid=69, state=SUCCESS; OpenRegionProcedure 9a6461924e1cac9cba18e02dc09c9189, server=jenkins-hbase9.apache.org,40505,1689101231800 in 177 msec 2023-07-11 18:47:28,463 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9a6461924e1cac9cba18e02dc09c9189#col#compaction#26 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:28,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=9a6461924e1cac9cba18e02dc09c9189, ASSIGN in 334 msec 2023-07-11 18:47:28,469 DEBUG [StoreOpener-3a1940ecd93b7c6a3b196c97cadecbb6-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80-top 2023-07-11 18:47:28,469 INFO [StoreOpener-3a1940ecd93b7c6a3b196c97cadecbb6-1] regionserver.HStore(310): Store=3a1940ecd93b7c6a3b196c97cadecbb6/col, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:28,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:28,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:28,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:28,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3a1940ecd93b7c6a3b196c97cadecbb6; next sequenceid=60; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66590250, jitterRate=-0.007727950811386108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:28,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3a1940ecd93b7c6a3b196c97cadecbb6: 2023-07-11 18:47:28,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6., pid=72, masterSystemTime=1689101248435 2023-07-11 18:47:28,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:28,477 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:28,477 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF col since it belongs to recently split daughter region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:28,477 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/.tmp/col/76f51ff2cc8f40128abf12210dbb5a16 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/76f51ff2cc8f40128abf12210dbb5a16 2023-07-11 18:47:28,477 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1912): 3a1940ecd93b7c6a3b196c97cadecbb6/col is initiating minor compaction (all files) 2023-07-11 18:47:28,478 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 3a1940ecd93b7c6a3b196c97cadecbb6/col in testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:28,478 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80-top] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/.tmp, totalSize=4.8 K 2023-07-11 18:47:28,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:28,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:28,479 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=70 updating hbase:meta row=3a1940ecd93b7c6a3b196c97cadecbb6, regionState=OPEN, openSeqNum=60, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:28,479 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.Compactor(207): Compacting 63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1, keycount=1, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=56, earliestPutTs=1689101247655 2023-07-11 18:47:28,479 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101248479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101248479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101248479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101248479"}]},"ts":"1689101248479"} 2023-07-11 18:47:28,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=70 2023-07-11 18:47:28,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=70, state=SUCCESS; OpenRegionProcedure 3a1940ecd93b7c6a3b196c97cadecbb6, server=jenkins-hbase9.apache.org,40505,1689101231800 in 196 msec 2023-07-11 18:47:28,483 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] throttle.PressureAwareThroughputController(145): 3a1940ecd93b7c6a3b196c97cadecbb6#col#compaction#27 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:28,484 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 9a6461924e1cac9cba18e02dc09c9189/col of 9a6461924e1cac9cba18e02dc09c9189 into 76f51ff2cc8f40128abf12210dbb5a16(size=4.8 K), total size for store is 4.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:28,485 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9a6461924e1cac9cba18e02dc09c9189: 2023-07-11 18:47:28,485 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189., storeName=9a6461924e1cac9cba18e02dc09c9189/col, priority=15, startTime=1689101248456; duration=0sec 2023-07-11 18:47:28,485 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:28,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=66 2023-07-11 18:47:28,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=3a1940ecd93b7c6a3b196c97cadecbb6, ASSIGN in 355 msec 2023-07-11 18:47:28,488 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; SplitTableRegionProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, parent=d5e64bf2fd2e5c458f152aa35d000fb1, daughterA=9a6461924e1cac9cba18e02dc09c9189, daughterB=3a1940ecd93b7c6a3b196c97cadecbb6 in 641 msec 2023-07-11 18:47:28,503 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/.tmp/col/70acab94f6e84a28ba917c73dc325c12 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/70acab94f6e84a28ba917c73dc325c12 2023-07-11 18:47:28,508 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 3a1940ecd93b7c6a3b196c97cadecbb6/col of 3a1940ecd93b7c6a3b196c97cadecbb6 into 70acab94f6e84a28ba917c73dc325c12(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:28,509 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3a1940ecd93b7c6a3b196c97cadecbb6: 2023-07-11 18:47:28,509 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6., storeName=3a1940ecd93b7c6a3b196c97cadecbb6/col, priority=15, startTime=1689101248476; duration=0sec 2023-07-11 18:47:28,509 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:28,848 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(675): waiting 2 regions to be available, got 2: [{ENCODED => 9a6461924e1cac9cba18e02dc09c9189, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.', STARTKEY => '', ENDKEY => 'row7'}, {ENCODED => 3a1940ecd93b7c6a3b196c97cadecbb6, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.', STARTKEY => 'row7', ENDKEY => ''}] 2023-07-11 18:47:28,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Scan size: 179 connection: 172.31.2.10:55438 deadline: 1689101308848, exception=org.apache.hadoop.hbase.NotServingRegionException: testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1. is not online on jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:28,961 DEBUG [Listener at localhost/44535] client.ClientScanner(240): Advancing internal scanner to startKey at 'row7', inclusive 2023-07-11 18:47:28,968 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(174): Tear down, remove table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:28,968 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:28,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:28,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=73, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:28,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=73 2023-07-11 18:47:28,973 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101248973"}]},"ts":"1689101248973"} 2023-07-11 18:47:28,974 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, state=DISABLING in hbase:meta 2023-07-11 18:47:28,976 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles to state=DISABLING 2023-07-11 18:47:28,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=9a6461924e1cac9cba18e02dc09c9189, UNASSIGN}, {pid=75, ppid=73, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=3a1940ecd93b7c6a3b196c97cadecbb6, UNASSIGN}] 2023-07-11 18:47:28,979 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=75, ppid=73, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=3a1940ecd93b7c6a3b196c97cadecbb6, UNASSIGN 2023-07-11 18:47:28,979 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=74, ppid=73, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=9a6461924e1cac9cba18e02dc09c9189, UNASSIGN 2023-07-11 18:47:28,979 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=3a1940ecd93b7c6a3b196c97cadecbb6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:28,979 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=9a6461924e1cac9cba18e02dc09c9189, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:28,980 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101248979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101248979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101248979"}]},"ts":"1689101248979"} 2023-07-11 18:47:28,980 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101248979"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101248979"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101248979"}]},"ts":"1689101248979"} 2023-07-11 18:47:28,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE; CloseRegionProcedure 3a1940ecd93b7c6a3b196c97cadecbb6, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:28,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=74, state=RUNNABLE; CloseRegionProcedure 9a6461924e1cac9cba18e02dc09c9189, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:29,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=73 2023-07-11 18:47:29,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:29,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9a6461924e1cac9cba18e02dc09c9189, disabling compactions & flushes 2023-07-11 18:47:29,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:29,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:29,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. after waiting 0 ms 2023-07-11 18:47:29,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:29,136 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80-bottom] to archive 2023-07-11 18:47:29,137 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:29,139 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:29,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits/63.seqid, newMaxSeqId=63, maxSeqId=59 2023-07-11 18:47:29,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189. 2023-07-11 18:47:29,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9a6461924e1cac9cba18e02dc09c9189: 2023-07-11 18:47:29,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:29,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:29,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3a1940ecd93b7c6a3b196c97cadecbb6, disabling compactions & flushes 2023-07-11 18:47:29,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:29,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:29,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. after waiting 0 ms 2023-07-11 18:47:29,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:29,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=74 updating hbase:meta row=9a6461924e1cac9cba18e02dc09c9189, regionState=CLOSED 2023-07-11 18:47:29,161 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80-top] to archive 2023-07-11 18:47:29,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101249161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101249161"}]},"ts":"1689101249161"} 2023-07-11 18:47:29,162 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:29,165 DEBUG [StoreCloser-testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:29,166 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=74 2023-07-11 18:47:29,166 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=74, state=SUCCESS; CloseRegionProcedure 9a6461924e1cac9cba18e02dc09c9189, server=jenkins-hbase9.apache.org,40505,1689101231800 in 182 msec 2023-07-11 18:47:29,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=9a6461924e1cac9cba18e02dc09c9189, UNASSIGN in 189 msec 2023-07-11 18:47:29,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits/63.seqid, newMaxSeqId=63, maxSeqId=59 2023-07-11 18:47:29,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6. 2023-07-11 18:47:29,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3a1940ecd93b7c6a3b196c97cadecbb6: 2023-07-11 18:47:29,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:29,179 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=75 updating hbase:meta row=3a1940ecd93b7c6a3b196c97cadecbb6, regionState=CLOSED 2023-07-11 18:47:29,179 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.","families":{"info":[{"qualifier":"regioninfo","vlen":93,"tag":[],"timestamp":"1689101249179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101249179"}]},"ts":"1689101249179"} 2023-07-11 18:47:29,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-07-11 18:47:29,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; CloseRegionProcedure 3a1940ecd93b7c6a3b196c97cadecbb6, server=jenkins-hbase9.apache.org,40505,1689101231800 in 199 msec 2023-07-11 18:47:29,183 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-11 18:47:29,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; TransitRegionStateProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, region=3a1940ecd93b7c6a3b196c97cadecbb6, UNASSIGN in 205 msec 2023-07-11 18:47:29,184 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101249184"}]},"ts":"1689101249184"} 2023-07-11 18:47:29,185 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, state=DISABLED in hbase:meta 2023-07-11 18:47:29,188 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles to state=DISABLED 2023-07-11 18:47:29,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, state=SUCCESS; DisableTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles in 232 msec 2023-07-11 18:47:29,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=73 2023-07-11 18:47:29,275 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, procId: 73 completed 2023-07-11 18:47:29,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:29,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:29,278 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:29,279 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:29,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-11 18:47:29,284 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:29,285 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:29,284 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:29,287 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits] 2023-07-11 18:47:29,287 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits] 2023-07-11 18:47:29,287 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits] 2023-07-11 18:47:29,291 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/76f51ff2cc8f40128abf12210dbb5a16 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/76f51ff2cc8f40128abf12210dbb5a16 2023-07-11 18:47:29,291 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/43308d3e9e75477c8b7911ffffe6a993 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/43308d3e9e75477c8b7911ffffe6a993 2023-07-11 18:47:29,291 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/70acab94f6e84a28ba917c73dc325c12 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/70acab94f6e84a28ba917c73dc325c12 2023-07-11 18:47:29,293 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80 2023-07-11 18:47:29,295 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits/63.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits/63.seqid 2023-07-11 18:47:29,295 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits/63.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits/63.seqid 2023-07-11 18:47:29,295 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189 2023-07-11 18:47:29,296 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:29,297 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits/59.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits/59.seqid 2023-07-11 18:47:29,297 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 2023-07-11 18:47:29,297 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles regions 2023-07-11 18:47:29,299 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:29,301 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles from hbase:meta 2023-07-11 18:47:29,303 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' descriptor. 2023-07-11 18:47:29,304 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:29,304 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' from region states. 2023-07-11 18:47:29,304 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101249304"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:29,304 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101249304"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:29,304 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101249304"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:29,305 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-11 18:47:29,305 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d5e64bf2fd2e5c458f152aa35d000fb1, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101244916.d5e64bf2fd2e5c458f152aa35d000fb1.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 9a6461924e1cac9cba18e02dc09c9189, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,,1689101247845.9a6461924e1cac9cba18e02dc09c9189.', STARTKEY => '', ENDKEY => 'row7'}, {ENCODED => 3a1940ecd93b7c6a3b196c97cadecbb6, NAME => 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles,row7,1689101247845.3a1940ecd93b7c6a3b196c97cadecbb6.', STARTKEY => 'row7', ENDKEY => ''}] 2023-07-11 18:47:29,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles' as deleted. 2023-07-11 18:47:29,305 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101249305"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:29,306 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles state from META 2023-07-11 18:47:29,308 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:29,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles in 32 msec 2023-07-11 18:47:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-07-11 18:47:29,381 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, procId: 78 completed 2023-07-11 18:47:29,396 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles Thread=428 (was 406) Potentially hanging thread: hconnection-0x30d957b8-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2022246434_17 at /127.0.0.1:37978 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2022246434_17 at /127.0.0.1:37952 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2022246434_17 at /127.0.0.1:57230 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:57272 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30d957b8-metaLookup-shared--pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:38114 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:38170 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2022246434_17 at /127.0.0.1:57170 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:37972 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30d957b8-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2022246434_17 at /127.0.0.1:37968 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:38198 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30d957b8-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:38136 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:58260 [Waiting for operation #28] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:58316 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30d957b8-metaLookup-shared--pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30d957b8-metaLookup-shared--pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:57206 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:34136 [Waiting for operation #32] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1023971383_17 at /127.0.0.1:47938 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=820 (was 768) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=286 (was 303), ProcessCount=170 (was 170), AvailableMemoryMB=7764 (was 7769) 2023-07-11 18:47:29,411 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testSplitFailedCompactionAndSplit Thread=428, OpenFileDescriptor=820, MaxFileDescriptor=60000, SystemLoadAverage=286, ProcessCount=170, AvailableMemoryMB=7764 2023-07-11 18:47:29,412 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:29,412 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:29,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testSplitFailedCompactionAndSplit', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:29,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:29,416 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testSplitFailedCompactionAndSplit execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:29,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testSplitFailedCompactionAndSplit" procId is: 79 2023-07-11 18:47:29,417 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testSplitFailedCompactionAndSplit execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:29,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 18:47:29,419 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,419 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 empty. 2023-07-11 18:47:29,420 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,420 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testSplitFailedCompactionAndSplit regions 2023-07-11 18:47:29,438 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:29,439 INFO [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(7675): creating {ENCODED => b7a313a1fe91c1be479ca52dccffaed5, NAME => 'testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testSplitFailedCompactionAndSplit', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:29,447 DEBUG [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(866): Instantiated testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:29,448 DEBUG [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(1604): Closing b7a313a1fe91c1be479ca52dccffaed5, disabling compactions & flushes 2023-07-11 18:47:29,448 INFO [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(1626): Closing region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:29,448 DEBUG [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:29,448 DEBUG [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(1714): Acquired close lock on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. after waiting 0 ms 2023-07-11 18:47:29,448 DEBUG [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(1724): Updates disabled for region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:29,448 INFO [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(1838): Closed testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:29,448 DEBUG [RegionOpenAndInit-testSplitFailedCompactionAndSplit-pool-0] regionserver.HRegion(1558): Region close journal for b7a313a1fe91c1be479ca52dccffaed5: 2023-07-11 18:47:29,450 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testSplitFailedCompactionAndSplit execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:29,451 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689101249451"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101249451"}]},"ts":"1689101249451"} 2023-07-11 18:47:29,452 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:29,453 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testSplitFailedCompactionAndSplit execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:29,453 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitFailedCompactionAndSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101249453"}]},"ts":"1689101249453"} 2023-07-11 18:47:29,454 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testSplitFailedCompactionAndSplit, state=ENABLING in hbase:meta 2023-07-11 18:47:29,457 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:29,458 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:29,458 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:29,458 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:29,458 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:29,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=b7a313a1fe91c1be479ca52dccffaed5, ASSIGN}] 2023-07-11 18:47:29,460 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=b7a313a1fe91c1be479ca52dccffaed5, ASSIGN 2023-07-11 18:47:29,460 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=b7a313a1fe91c1be479ca52dccffaed5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:29,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 18:47:29,611 INFO [jenkins-hbase9:39147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:29,612 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=b7a313a1fe91c1be479ca52dccffaed5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:29,612 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689101249612"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101249612"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101249612"}]},"ts":"1689101249612"} 2023-07-11 18:47:29,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE; OpenRegionProcedure b7a313a1fe91c1be479ca52dccffaed5, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:29,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 18:47:29,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:29,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b7a313a1fe91c1be479ca52dccffaed5, NAME => 'testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:29,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitFailedCompactionAndSplit b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:29,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,770 INFO [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,771 DEBUG [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf 2023-07-11 18:47:29,771 DEBUG [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf 2023-07-11 18:47:29,772 INFO [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7a313a1fe91c1be479ca52dccffaed5 columnFamilyName cf 2023-07-11 18:47:29,772 INFO [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] regionserver.HStore(310): Store=b7a313a1fe91c1be479ca52dccffaed5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:29,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:29,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:29,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b7a313a1fe91c1be479ca52dccffaed5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65213063, jitterRate=-0.02824963629245758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:29,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b7a313a1fe91c1be479ca52dccffaed5: 2023-07-11 18:47:29,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5., pid=81, masterSystemTime=1689101249765 2023-07-11 18:47:29,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:29,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:29,780 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=b7a313a1fe91c1be479ca52dccffaed5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:29,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689101249780"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101249780"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101249780"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101249780"}]},"ts":"1689101249780"} 2023-07-11 18:47:29,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-11 18:47:29,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; OpenRegionProcedure b7a313a1fe91c1be479ca52dccffaed5, server=jenkins-hbase9.apache.org,40505,1689101231800 in 169 msec 2023-07-11 18:47:29,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-07-11 18:47:29,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=b7a313a1fe91c1be479ca52dccffaed5, ASSIGN in 325 msec 2023-07-11 18:47:29,785 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testSplitFailedCompactionAndSplit execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:29,785 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitFailedCompactionAndSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101249785"}]},"ts":"1689101249785"} 2023-07-11 18:47:29,786 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitFailedCompactionAndSplit, state=ENABLED in hbase:meta 2023-07-11 18:47:29,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testSplitFailedCompactionAndSplit execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:29,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testSplitFailedCompactionAndSplit in 375 msec 2023-07-11 18:47:30,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-07-11 18:47:30,021 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testSplitFailedCompactionAndSplit, procId: 79 completed 2023-07-11 18:47:30,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:30,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,033 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitFailedCompactionAndSplit' 2023-07-11 18:47:30,033 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:30,033 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitFailedCompactionAndSplit' starting 'acquire' 2023-07-11 18:47:30,033 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitFailedCompactionAndSplit', kicking off acquire phase on members. 2023-07-11 18:47:30,033 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,033 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,035 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,035 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,035 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,035 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,035 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,035 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitFailedCompactionAndSplit' with timeout 60000ms 2023-07-11 18:47:30,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitFailedCompactionAndSplit' with timeout 60000ms 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitFailedCompactionAndSplit' starting 'acquire' stage 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitFailedCompactionAndSplit' with timeout 60000ms 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitFailedCompactionAndSplit' starting 'acquire' stage 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitFailedCompactionAndSplit' starting 'acquire' stage 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitFailedCompactionAndSplit' locally acquired 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitFailedCompactionAndSplit' locally acquired 2023-07-11 18:47:30,037 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:30,037 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. started... 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitFailedCompactionAndSplit) in zk 2023-07-11 18:47:30,037 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitFailedCompactionAndSplit) in zk 2023-07-11 18:47:30,038 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b7a313a1fe91c1be479ca52dccffaed5 1/1 column families, dataSize=116 B heapSize=672 B 2023-07-11 18:47:30,040 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,040 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,040 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,040 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitFailedCompactionAndSplit' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:30,040 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,040 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitFailedCompactionAndSplit' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:30,051 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/.tmp/cf/2599a0deabee4da8a1aa887f0bee2810 2023-07-11 18:47:30,057 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/.tmp/cf/2599a0deabee4da8a1aa887f0bee2810 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810 2023-07-11 18:47:30,062 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810, entries=4, sequenceid=8, filesize=4.8 K 2023-07-11 18:47:30,063 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~116 B/116, heapSize ~656 B/656, currentSize=0 B/0 for b7a313a1fe91c1be479ca52dccffaed5 in 25ms, sequenceid=8, compaction requested=false 2023-07-11 18:47:30,063 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testSplitFailedCompactionAndSplit' 2023-07-11 18:47:30,063 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b7a313a1fe91c1be479ca52dccffaed5: 2023-07-11 18:47:30,063 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,063 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:30,063 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:30,063 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,064 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitFailedCompactionAndSplit' locally acquired 2023-07-11 18:47:30,064 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitFailedCompactionAndSplit) in zk 2023-07-11 18:47:30,065 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,065 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:30,065 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,065 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitFailedCompactionAndSplit' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:30,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitFailedCompactionAndSplit' on coordinator 2023-07-11 18:47:30,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6959321e[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:30,067 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitFailedCompactionAndSplit' starting 'in-barrier' execution. 2023-07-11 18:47:30,067 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitFailedCompactionAndSplit' received 'reached' from coordinator. 2023-07-11 18:47:30,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitFailedCompactionAndSplit' received 'reached' from coordinator. 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitFailedCompactionAndSplit' locally completed 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitFailedCompactionAndSplit' locally completed 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitFailedCompactionAndSplit' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:30,070 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,070 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitFailedCompactionAndSplit' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitFailedCompactionAndSplit' received 'reached' from coordinator. 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitFailedCompactionAndSplit' locally completed 2023-07-11 18:47:30,070 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitFailedCompactionAndSplit' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:30,071 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitFailedCompactionAndSplit' has notified controller of completion 2023-07-11 18:47:30,071 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitFailedCompactionAndSplit' has notified controller of completion 2023-07-11 18:47:30,072 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:30,071 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:30,072 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitFailedCompactionAndSplit' completed. 2023-07-11 18:47:30,072 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitFailedCompactionAndSplit' completed. 2023-07-11 18:47:30,072 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,072 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitFailedCompactionAndSplit' has notified controller of completion 2023-07-11 18:47:30,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:30,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:30,072 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:30,073 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitFailedCompactionAndSplit' completed. 2023-07-11 18:47:30,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:30,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:30,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:30,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitFailedCompactionAndSplit' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:30,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitFailedCompactionAndSplit', counting down latch. Waiting for 0 more 2023-07-11 18:47:30,075 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitFailedCompactionAndSplit' execution completed 2023-07-11 18:47:30,076 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:30,076 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:30,076 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,076 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitFailedCompactionAndSplitincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:30,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:30,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:30,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,078 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:30,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,078 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,079 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,081 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:30,081 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,081 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,084 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,085 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:30,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitFailedCompactionAndSplit' 2023-07-11 18:47:30,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitFailedCompactionAndSplit'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,085 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,086 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,086 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,086 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,086 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,086 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,138 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:47:30,185 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:30,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:30,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:30,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(143): Procedure testSplitFailedCompactionAndSplit was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:30,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,197 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitFailedCompactionAndSplit' 2023-07-11 18:47:30,197 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:30,197 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitFailedCompactionAndSplit' starting 'acquire' 2023-07-11 18:47:30,197 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitFailedCompactionAndSplit', kicking off acquire phase on members. 2023-07-11 18:47:30,198 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,198 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,199 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,199 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,199 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,199 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,200 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,200 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitFailedCompactionAndSplit is still present, removing 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitFailedCompactionAndSplit is still present, removing 2023-07-11 18:47:30,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,201 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitFailedCompactionAndSplit' with timeout 60000ms 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitFailedCompactionAndSplit' with timeout 60000ms 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:30,202 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitFailedCompactionAndSplit is still present, removing 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitFailedCompactionAndSplit' starting 'acquire' stage 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitFailedCompactionAndSplit' locally acquired 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitFailedCompactionAndSplit) in zk 2023-07-11 18:47:30,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitFailedCompactionAndSplit' starting 'acquire' stage 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitFailedCompactionAndSplit' with timeout 60000ms 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitFailedCompactionAndSplit' locally acquired 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitFailedCompactionAndSplit) in zk 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitFailedCompactionAndSplit' starting 'acquire' stage 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:30,202 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:30,202 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,202 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. started... 2023-07-11 18:47:30,202 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b7a313a1fe91c1be479ca52dccffaed5 1/1 column families, dataSize=116 B heapSize=672 B 2023-07-11 18:47:30,206 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,208 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,208 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,208 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitFailedCompactionAndSplit' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:30,208 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,208 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitFailedCompactionAndSplit' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:30,219 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=15 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/.tmp/cf/bb1b05c500ac4d9ea0ede28f12cbb01e 2023-07-11 18:47:30,225 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/.tmp/cf/bb1b05c500ac4d9ea0ede28f12cbb01e as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e 2023-07-11 18:47:30,230 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e, entries=4, sequenceid=15, filesize=4.8 K 2023-07-11 18:47:30,231 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~116 B/116, heapSize ~656 B/656, currentSize=0 B/0 for b7a313a1fe91c1be479ca52dccffaed5 in 29ms, sequenceid=15, compaction requested=false 2023-07-11 18:47:30,231 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b7a313a1fe91c1be479ca52dccffaed5: 2023-07-11 18:47:30,231 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,231 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:30,231 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:30,231 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,231 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitFailedCompactionAndSplit' locally acquired 2023-07-11 18:47:30,231 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitFailedCompactionAndSplit) in zk 2023-07-11 18:47:30,232 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,232 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:30,233 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,233 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitFailedCompactionAndSplit' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:30,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitFailedCompactionAndSplit' on coordinator 2023-07-11 18:47:30,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6eaeac8b[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:30,234 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitFailedCompactionAndSplit' starting 'in-barrier' execution. 2023-07-11 18:47:30,235 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitFailedCompactionAndSplit' received 'reached' from coordinator. 2023-07-11 18:47:30,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,236 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitFailedCompactionAndSplit' received 'reached' from coordinator. 2023-07-11 18:47:30,236 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitFailedCompactionAndSplit' received 'reached' from coordinator. 2023-07-11 18:47:30,236 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitFailedCompactionAndSplit' locally completed 2023-07-11 18:47:30,236 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitFailedCompactionAndSplit' locally completed 2023-07-11 18:47:30,236 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,237 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:30,236 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitFailedCompactionAndSplit' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:30,236 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitFailedCompactionAndSplit' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:30,236 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitFailedCompactionAndSplit' locally completed 2023-07-11 18:47:30,237 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitFailedCompactionAndSplit' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:30,238 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitFailedCompactionAndSplit' has notified controller of completion 2023-07-11 18:47:30,238 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:30,238 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,238 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitFailedCompactionAndSplit' completed. 2023-07-11 18:47:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:30,242 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitFailedCompactionAndSplit' has notified controller of completion 2023-07-11 18:47:30,242 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitFailedCompactionAndSplit' has notified controller of completion 2023-07-11 18:47:30,242 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:30,242 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:30,242 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitFailedCompactionAndSplit' completed. 2023-07-11 18:47:30,242 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitFailedCompactionAndSplit' completed. 2023-07-11 18:47:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitFailedCompactionAndSplit' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:30,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitFailedCompactionAndSplit', counting down latch. Waiting for 0 more 2023-07-11 18:47:30,246 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitFailedCompactionAndSplit' execution completed 2023-07-11 18:47:30,246 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:30,246 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:30,246 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,246 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitFailedCompactionAndSplitincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:30,247 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,247 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:30,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,247 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,247 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,247 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,247 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,248 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,248 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,248 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,249 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:30,250 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,251 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,251 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,253 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,253 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:30,253 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitFailedCompactionAndSplit' 2023-07-11 18:47:30,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:30,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:30,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:30,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:30,254 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:30,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitFailedCompactionAndSplit'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:30,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:30,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:30,255 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,254 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:30,255 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:30,255 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,255 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,255 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:30,255 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,255 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitFailedCompactionAndSplit 2023-07-11 18:47:30,355 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:30,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:30,356 DEBUG [Listener at localhost/44535] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-11 18:47:30,356 DEBUG [Listener at localhost/44535] regionserver.HStore(1912): b7a313a1fe91c1be479ca52dccffaed5/cf is initiating major compaction (all files) 2023-07-11 18:47:30,356 DEBUG [Listener at localhost/44535] regionserver.HRegion(1604): Closing b7a313a1fe91c1be479ca52dccffaed5, disabling compactions & flushes 2023-07-11 18:47:30,357 INFO [Listener at localhost/44535] regionserver.HRegion(1626): Closing region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,357 DEBUG [Listener at localhost/44535] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,357 DEBUG [Listener at localhost/44535] regionserver.HRegion(1714): Acquired close lock on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. after waiting 0 ms 2023-07-11 18:47:30,357 DEBUG [Listener at localhost/44535] regionserver.HRegion(1724): Updates disabled for region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,368 DEBUG [Listener at localhost/44535] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits/18.seqid, newMaxSeqId=18, maxSeqId=1 2023-07-11 18:47:30,369 INFO [Listener at localhost/44535] regionserver.HRegion(1838): Closed testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,369 DEBUG [Listener at localhost/44535] regionserver.HRegion(1558): Region close journal for b7a313a1fe91c1be479ca52dccffaed5: 2023-07-11 18:47:30,370 INFO [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,371 DEBUG [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf 2023-07-11 18:47:30,371 DEBUG [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf 2023-07-11 18:47:30,371 INFO [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7a313a1fe91c1be479ca52dccffaed5 columnFamilyName cf 2023-07-11 18:47:30,377 DEBUG [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810 2023-07-11 18:47:30,381 DEBUG [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e 2023-07-11 18:47:30,381 INFO [StoreOpener-b7a313a1fe91c1be479ca52dccffaed5-1] regionserver.HStore(310): Store=b7a313a1fe91c1be479ca52dccffaed5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:30,382 DEBUG [Listener at localhost/44535] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,383 DEBUG [Listener at localhost/44535] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,385 DEBUG [Listener at localhost/44535] regionserver.HRegion(1055): writing seq id for b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,386 INFO [Listener at localhost/44535] regionserver.HRegion(1072): Opened b7a313a1fe91c1be479ca52dccffaed5; next sequenceid=19; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67294253, jitterRate=0.002762511372566223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:30,386 DEBUG [Listener at localhost/44535] regionserver.HRegion(965): Region open journal for b7a313a1fe91c1be479ca52dccffaed5: 2023-07-11 18:47:30,386 WARN [Listener at localhost/44535] regionserver.HRegion(2233): Store cf on region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. has been re-instantiated, cancel this compaction request. It may be caused by the roll back of split transaction 2023-07-11 18:47:30,386 INFO [Listener at localhost/44535] master.HMaster$3(1981): Client=null/null split testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,387 DEBUG [Listener at localhost/44535] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,387 DEBUG [Listener at localhost/44535] procedure2.ProcedureExecutor(1029): Stored pid=82, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitFailedCompactionAndSplit, parent=b7a313a1fe91c1be479ca52dccffaed5, daughterA=58ff9798160037433aff3914405d3ea1, daughterB=f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,388 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitFailedCompactionAndSplit, parent=b7a313a1fe91c1be479ca52dccffaed5, daughterA=58ff9798160037433aff3914405d3ea1, daughterB=f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,388 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitFailedCompactionAndSplit, parent=b7a313a1fe91c1be479ca52dccffaed5, daughterA=58ff9798160037433aff3914405d3ea1, daughterB=f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,388 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitFailedCompactionAndSplit, parent=b7a313a1fe91c1be479ca52dccffaed5, daughterA=58ff9798160037433aff3914405d3ea1, daughterB=f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=b7a313a1fe91c1be479ca52dccffaed5, UNASSIGN}] 2023-07-11 18:47:30,391 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=83, ppid=82, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=b7a313a1fe91c1be479ca52dccffaed5, UNASSIGN 2023-07-11 18:47:30,392 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=83 updating hbase:meta row=b7a313a1fe91c1be479ca52dccffaed5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,392 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689101250392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101250392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101250392"}]},"ts":"1689101250392"} 2023-07-11 18:47:30,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=83, state=RUNNABLE; CloseRegionProcedure b7a313a1fe91c1be479ca52dccffaed5, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:30,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b7a313a1fe91c1be479ca52dccffaed5, disabling compactions & flushes 2023-07-11 18:47:30,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. after waiting 0 ms 2023-07-11 18:47:30,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits/19.seqid, newMaxSeqId=19, maxSeqId=18 2023-07-11 18:47:30,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5. 2023-07-11 18:47:30,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b7a313a1fe91c1be479ca52dccffaed5: 2023-07-11 18:47:30,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,552 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=83 updating hbase:meta row=b7a313a1fe91c1be479ca52dccffaed5, regionState=CLOSED 2023-07-11 18:47:30,553 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689101250552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101250552"}]},"ts":"1689101250552"} 2023-07-11 18:47:30,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=83 2023-07-11 18:47:30,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=83, state=SUCCESS; CloseRegionProcedure b7a313a1fe91c1be479ca52dccffaed5, server=jenkins-hbase9.apache.org,40505,1689101231800 in 160 msec 2023-07-11 18:47:30,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=82 2023-07-11 18:47:30,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=82, state=SUCCESS; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=b7a313a1fe91c1be479ca52dccffaed5, UNASSIGN in 165 msec 2023-07-11 18:47:30,563 INFO [PEWorker-5] assignment.SplitTableRegionProcedure(694): pid=82 splitting 2 storefiles, region=b7a313a1fe91c1be479ca52dccffaed5, threads=2 2023-07-11 18:47:30,563 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=82 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810 for region: b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,564 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=82 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e for region: b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,595 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=82 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810 for region: b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,595 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=82 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e for region: b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:30,595 DEBUG [PEWorker-5] assignment.SplitTableRegionProcedure(755): pid=82 split storefiles for region b7a313a1fe91c1be479ca52dccffaed5 Daughter A: 2 storefiles, Daughter B: 2 storefiles. 2023-07-11 18:47:30,622 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits/19.seqid, newMaxSeqId=19, maxSeqId=-1 2023-07-11 18:47:30,623 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits/19.seqid, newMaxSeqId=19, maxSeqId=-1 2023-07-11 18:47:30,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689101250625"},{"qualifier":"splitA","vlen":71,"tag":[],"timestamp":"1689101250625"},{"qualifier":"splitB","vlen":71,"tag":[],"timestamp":"1689101250625"}]},"ts":"1689101250625"} 2023-07-11 18:47:30,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101250625"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101250625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101250625"}]},"ts":"1689101250625"} 2023-07-11 18:47:30,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101250625"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101250625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101250625"}]},"ts":"1689101250625"} 2023-07-11 18:47:30,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=58ff9798160037433aff3914405d3ea1, ASSIGN}, {pid=86, ppid=82, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=f2a2d598705454a709d7057c7f772c3a, ASSIGN}] 2023-07-11 18:47:30,629 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=82, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=f2a2d598705454a709d7057c7f772c3a, ASSIGN 2023-07-11 18:47:30,629 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=82, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=58ff9798160037433aff3914405d3ea1, ASSIGN 2023-07-11 18:47:30,629 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=86, ppid=82, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=f2a2d598705454a709d7057c7f772c3a, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:30,629 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=85, ppid=82, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=58ff9798160037433aff3914405d3ea1, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:30,780 INFO [jenkins-hbase9:39147] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:30,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f2a2d598705454a709d7057c7f772c3a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=58ff9798160037433aff3914405d3ea1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,781 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101250781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101250781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101250781"}]},"ts":"1689101250781"} 2023-07-11 18:47:30,782 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101250781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101250781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101250781"}]},"ts":"1689101250781"} 2023-07-11 18:47:30,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; OpenRegionProcedure f2a2d598705454a709d7057c7f772c3a, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:30,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; OpenRegionProcedure 58ff9798160037433aff3914405d3ea1, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:30,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:30,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f2a2d598705454a709d7057c7f772c3a, NAME => 'testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.', STARTKEY => 'row3', ENDKEY => ''} 2023-07-11 18:47:30,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitFailedCompactionAndSplit f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:30,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,942 INFO [StoreOpener-f2a2d598705454a709d7057c7f772c3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,943 DEBUG [StoreOpener-f2a2d598705454a709d7057c7f772c3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf 2023-07-11 18:47:30,943 DEBUG [StoreOpener-f2a2d598705454a709d7057c7f772c3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf 2023-07-11 18:47:30,943 INFO [StoreOpener-f2a2d598705454a709d7057c7f772c3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2a2d598705454a709d7057c7f772c3a columnFamilyName cf 2023-07-11 18:47:30,952 DEBUG [StoreOpener-f2a2d598705454a709d7057c7f772c3a-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810-top 2023-07-11 18:47:30,956 DEBUG [StoreOpener-f2a2d598705454a709d7057c7f772c3a-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e-top 2023-07-11 18:47:30,956 INFO [StoreOpener-f2a2d598705454a709d7057c7f772c3a-1] regionserver.HStore(310): Store=f2a2d598705454a709d7057c7f772c3a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:30,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:30,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f2a2d598705454a709d7057c7f772c3a; next sequenceid=20; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68654623, jitterRate=0.02303360402584076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:30,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f2a2d598705454a709d7057c7f772c3a: 2023-07-11 18:47:30,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a., pid=87, masterSystemTime=1689101250936 2023-07-11 18:47:30,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:30,963 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-11 18:47:30,964 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:30,964 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1912): f2a2d598705454a709d7057c7f772c3a/cf is initiating minor compaction (all files) 2023-07-11 18:47:30,964 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f2a2d598705454a709d7057c7f772c3a/cf in testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:30,964 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810-top, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e-top] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/.tmp, totalSize=9.7 K 2023-07-11 18:47:30,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:30,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:30,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:30,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 58ff9798160037433aff3914405d3ea1, NAME => 'testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.', STARTKEY => '', ENDKEY => 'row3'} 2023-07-11 18:47:30,964 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting 2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5, keycount=2, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689101250024 2023-07-11 18:47:30,965 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f2a2d598705454a709d7057c7f772c3a, regionState=OPEN, openSeqNum=20, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitFailedCompactionAndSplit 58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:30,965 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101250964"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101250964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101250964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101250964"}]},"ts":"1689101250964"} 2023-07-11 18:47:30,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:30,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:30,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:30,965 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5, keycount=2, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=16, earliestPutTs=1689101250187 2023-07-11 18:47:30,966 INFO [StoreOpener-58ff9798160037433aff3914405d3ea1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:30,968 DEBUG [StoreOpener-58ff9798160037433aff3914405d3ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf 2023-07-11 18:47:30,968 DEBUG [StoreOpener-58ff9798160037433aff3914405d3ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf 2023-07-11 18:47:30,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-11 18:47:30,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; OpenRegionProcedure f2a2d598705454a709d7057c7f772c3a, server=jenkins-hbase9.apache.org,40505,1689101231800 in 183 msec 2023-07-11 18:47:30,968 INFO [StoreOpener-58ff9798160037433aff3914405d3ea1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58ff9798160037433aff3914405d3ea1 columnFamilyName cf 2023-07-11 18:47:30,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=82, state=SUCCESS; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=f2a2d598705454a709d7057c7f772c3a, ASSIGN in 340 msec 2023-07-11 18:47:30,973 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] throttle.PressureAwareThroughputController(145): f2a2d598705454a709d7057c7f772c3a#cf#compaction#30 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:30,978 DEBUG [StoreOpener-58ff9798160037433aff3914405d3ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810-bottom 2023-07-11 18:47:30,982 DEBUG [StoreOpener-58ff9798160037433aff3914405d3ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e-bottom 2023-07-11 18:47:30,982 INFO [StoreOpener-58ff9798160037433aff3914405d3ea1-1] regionserver.HStore(310): Store=58ff9798160037433aff3914405d3ea1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:30,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:30,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:30,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:30,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 58ff9798160037433aff3914405d3ea1; next sequenceid=20; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72700449, jitterRate=0.08332110941410065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:30,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 58ff9798160037433aff3914405d3ea1: 2023-07-11 18:47:30,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1., pid=88, masterSystemTime=1689101250936 2023-07-11 18:47:30,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:30,990 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-11 18:47:30,991 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:30,991 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1912): 58ff9798160037433aff3914405d3ea1/cf is initiating minor compaction (all files) 2023-07-11 18:47:30,991 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/.tmp/cf/9e135334a6af4c75b9715bc7bd0aca23 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/9e135334a6af4c75b9715bc7bd0aca23 2023-07-11 18:47:30,991 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 58ff9798160037433aff3914405d3ea1/cf in testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:30,991 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810-bottom, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e-bottom] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/.tmp, totalSize=9.7 K 2023-07-11 18:47:30,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:30,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:30,992 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.Compactor(207): Compacting 2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5, keycount=2, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1689101250024 2023-07-11 18:47:30,992 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=58ff9798160037433aff3914405d3ea1, regionState=OPEN, openSeqNum=20, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:30,992 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101250992"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101250992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101250992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101250992"}]},"ts":"1689101250992"} 2023-07-11 18:47:30,992 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.Compactor(207): Compacting bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5, keycount=2, bloomtype=ROW, size=4.8 K, encoding=NONE, compression=NONE, seqNum=15, earliestPutTs=1689101250187 2023-07-11 18:47:30,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-11 18:47:30,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; OpenRegionProcedure 58ff9798160037433aff3914405d3ea1, server=jenkins-hbase9.apache.org,40505,1689101231800 in 209 msec 2023-07-11 18:47:30,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-07-11 18:47:30,997 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 (all) file(s) in f2a2d598705454a709d7057c7f772c3a/cf of f2a2d598705454a709d7057c7f772c3a into 9e135334a6af4c75b9715bc7bd0aca23(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:30,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=58ff9798160037433aff3914405d3ea1, ASSIGN in 368 msec 2023-07-11 18:47:30,998 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f2a2d598705454a709d7057c7f772c3a: 2023-07-11 18:47:30,998 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a., storeName=f2a2d598705454a709d7057c7f772c3a/cf, priority=14, startTime=1689101250962; duration=0sec 2023-07-11 18:47:30,998 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:30,998 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] throttle.PressureAwareThroughputController(145): 58ff9798160037433aff3914405d3ea1#cf#compaction#31 average throughput is unlimited, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:30,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, state=SUCCESS; SplitTableRegionProcedure table=testSplitFailedCompactionAndSplit, parent=b7a313a1fe91c1be479ca52dccffaed5, daughterA=58ff9798160037433aff3914405d3ea1, daughterB=f2a2d598705454a709d7057c7f772c3a in 610 msec 2023-07-11 18:47:31,011 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/.tmp/cf/2cbeb3f513534543878f017c83520c26 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2cbeb3f513534543878f017c83520c26 2023-07-11 18:47:31,016 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 (all) file(s) in 58ff9798160037433aff3914405d3ea1/cf of 58ff9798160037433aff3914405d3ea1 into 2cbeb3f513534543878f017c83520c26(size=4.9 K), total size for store is 4.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:31,016 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 58ff9798160037433aff3914405d3ea1: 2023-07-11 18:47:31,016 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1., storeName=58ff9798160037433aff3914405d3ea1/cf, priority=14, startTime=1689101250989; duration=0sec 2023-07-11 18:47:31,016 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:31,139 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(174): Tear down, remove table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,140 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 18:47:31,144 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitFailedCompactionAndSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101251143"}]},"ts":"1689101251143"} 2023-07-11 18:47:31,145 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testSplitFailedCompactionAndSplit, state=DISABLING in hbase:meta 2023-07-11 18:47:31,146 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testSplitFailedCompactionAndSplit to state=DISABLING 2023-07-11 18:47:31,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=90, ppid=89, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=58ff9798160037433aff3914405d3ea1, UNASSIGN}, {pid=91, ppid=89, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=f2a2d598705454a709d7057c7f772c3a, UNASSIGN}] 2023-07-11 18:47:31,148 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=89, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=58ff9798160037433aff3914405d3ea1, UNASSIGN 2023-07-11 18:47:31,148 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=89, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=f2a2d598705454a709d7057c7f772c3a, UNASSIGN 2023-07-11 18:47:31,149 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=58ff9798160037433aff3914405d3ea1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:31,149 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101251149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101251149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101251149"}]},"ts":"1689101251149"} 2023-07-11 18:47:31,149 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f2a2d598705454a709d7057c7f772c3a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:31,149 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101251149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101251149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101251149"}]},"ts":"1689101251149"} 2023-07-11 18:47:31,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 58ff9798160037433aff3914405d3ea1, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:31,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure f2a2d598705454a709d7057c7f772c3a, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:31,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 18:47:31,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:31,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 58ff9798160037433aff3914405d3ea1, disabling compactions & flushes 2023-07-11 18:47:31,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:31,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:31,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. after waiting 0 ms 2023-07-11 18:47:31,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:31,302 DEBUG [StoreCloser-testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810-bottom, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e-bottom] to archive 2023-07-11 18:47:31,303 DEBUG [StoreCloser-testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:31,305 DEBUG [StoreCloser-testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:31,306 DEBUG [StoreCloser-testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:31,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits/23.seqid, newMaxSeqId=23, maxSeqId=19 2023-07-11 18:47:31,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1. 2023-07-11 18:47:31,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 58ff9798160037433aff3914405d3ea1: 2023-07-11 18:47:31,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:31,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:31,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f2a2d598705454a709d7057c7f772c3a, disabling compactions & flushes 2023-07-11 18:47:31,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:31,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:31,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. after waiting 0 ms 2023-07-11 18:47:31,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:31,312 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=58ff9798160037433aff3914405d3ea1, regionState=CLOSED 2023-07-11 18:47:31,312 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101251312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101251312"}]},"ts":"1689101251312"} 2023-07-11 18:47:31,312 DEBUG [StoreCloser-testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810-top, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e-top] to archive 2023-07-11 18:47:31,313 DEBUG [StoreCloser-testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:31,315 DEBUG [StoreCloser-testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:31,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-11 18:47:31,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 58ff9798160037433aff3914405d3ea1, server=jenkins-hbase9.apache.org,40505,1689101231800 in 163 msec 2023-07-11 18:47:31,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=89, state=SUCCESS; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=58ff9798160037433aff3914405d3ea1, UNASSIGN in 168 msec 2023-07-11 18:47:31,316 DEBUG [StoreCloser-testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:31,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits/23.seqid, newMaxSeqId=23, maxSeqId=19 2023-07-11 18:47:31,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a. 2023-07-11 18:47:31,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f2a2d598705454a709d7057c7f772c3a: 2023-07-11 18:47:31,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:31,321 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f2a2d598705454a709d7057c7f772c3a, regionState=CLOSED 2023-07-11 18:47:31,321 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101251321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101251321"}]},"ts":"1689101251321"} 2023-07-11 18:47:31,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-11 18:47:31,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure f2a2d598705454a709d7057c7f772c3a, server=jenkins-hbase9.apache.org,40505,1689101231800 in 171 msec 2023-07-11 18:47:31,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=89 2023-07-11 18:47:31,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=89, state=SUCCESS; TransitRegionStateProcedure table=testSplitFailedCompactionAndSplit, region=f2a2d598705454a709d7057c7f772c3a, UNASSIGN in 177 msec 2023-07-11 18:47:31,326 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitFailedCompactionAndSplit","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101251325"}]},"ts":"1689101251325"} 2023-07-11 18:47:31,327 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testSplitFailedCompactionAndSplit, state=DISABLED in hbase:meta 2023-07-11 18:47:31,328 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testSplitFailedCompactionAndSplit to state=DISABLED 2023-07-11 18:47:31,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DisableTableProcedure table=testSplitFailedCompactionAndSplit in 189 msec 2023-07-11 18:47:31,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 18:47:31,446 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testSplitFailedCompactionAndSplit, procId: 89 completed 2023-07-11 18:47:31,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=94, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,449 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=94, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,449 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=94, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=94 2023-07-11 18:47:31,454 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:31,454 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:31,454 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:31,456 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits] 2023-07-11 18:47:31,456 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits] 2023-07-11 18:47:31,456 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits] 2023-07-11 18:47:31,460 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2cbeb3f513534543878f017c83520c26 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2cbeb3f513534543878f017c83520c26 2023-07-11 18:47:31,461 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/9e135334a6af4c75b9715bc7bd0aca23 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/9e135334a6af4c75b9715bc7bd0aca23 2023-07-11 18:47:31,461 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810 2023-07-11 18:47:31,463 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e 2023-07-11 18:47:31,465 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits/23.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits/23.seqid 2023-07-11 18:47:31,465 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits/23.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits/23.seqid 2023-07-11 18:47:31,466 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1 2023-07-11 18:47:31,466 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:31,467 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits/19.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits/19.seqid 2023-07-11 18:47:31,467 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 2023-07-11 18:47:31,467 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testSplitFailedCompactionAndSplit regions 2023-07-11 18:47:31,470 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=94, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,472 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testSplitFailedCompactionAndSplit from hbase:meta 2023-07-11 18:47:31,473 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testSplitFailedCompactionAndSplit' descriptor. 2023-07-11 18:47:31,474 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=94, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testSplitFailedCompactionAndSplit' from region states. 2023-07-11 18:47:31,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101251475"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:31,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101251475"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:31,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101251475"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:31,476 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-11 18:47:31,476 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b7a313a1fe91c1be479ca52dccffaed5, NAME => 'testSplitFailedCompactionAndSplit,,1689101249414.b7a313a1fe91c1be479ca52dccffaed5.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 58ff9798160037433aff3914405d3ea1, NAME => 'testSplitFailedCompactionAndSplit,,1689101250387.58ff9798160037433aff3914405d3ea1.', STARTKEY => '', ENDKEY => 'row3'}, {ENCODED => f2a2d598705454a709d7057c7f772c3a, NAME => 'testSplitFailedCompactionAndSplit,row3,1689101250387.f2a2d598705454a709d7057c7f772c3a.', STARTKEY => 'row3', ENDKEY => ''}] 2023-07-11 18:47:31,476 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testSplitFailedCompactionAndSplit' as deleted. 2023-07-11 18:47:31,477 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitFailedCompactionAndSplit","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101251476"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:31,478 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testSplitFailedCompactionAndSplit state from META 2023-07-11 18:47:31,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=94, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:31,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, state=SUCCESS; DeleteTableProcedure table=testSplitFailedCompactionAndSplit in 34 msec 2023-07-11 18:47:31,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=94 2023-07-11 18:47:31,551 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testSplitFailedCompactionAndSplit, procId: 94 completed 2023-07-11 18:47:31,565 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testSplitFailedCompactionAndSplit Thread=426 (was 428), OpenFileDescriptor=818 (was 820), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=286 (was 286), ProcessCount=170 (was 170), AvailableMemoryMB=7760 (was 7764) 2023-07-11 18:47:31,580 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testRITStateForRollback Thread=426, OpenFileDescriptor=818, MaxFileDescriptor=60000, SystemLoadAverage=286, ProcessCount=170, AvailableMemoryMB=7760 2023-07-11 18:47:31,580 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:31,580 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:31,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testRITStateForRollback', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:31,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRITStateForRollback 2023-07-11 18:47:31,585 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=95, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRITStateForRollback execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:31,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testRITStateForRollback" procId is: 95 2023-07-11 18:47:31,586 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=95, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRITStateForRollback execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:31,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=95 2023-07-11 18:47:31,588 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,588 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 empty. 2023-07-11 18:47:31,589 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,589 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRITStateForRollback regions 2023-07-11 18:47:31,599 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:31,601 INFO [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(7675): creating {ENCODED => 864e1811adec64ed8b346b0fa5959647, NAME => 'testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRITStateForRollback', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:31,608 DEBUG [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(866): Instantiated testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:31,608 DEBUG [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(1604): Closing 864e1811adec64ed8b346b0fa5959647, disabling compactions & flushes 2023-07-11 18:47:31,608 INFO [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(1626): Closing region testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:31,608 DEBUG [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:31,608 DEBUG [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(1714): Acquired close lock on testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. after waiting 0 ms 2023-07-11 18:47:31,608 DEBUG [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(1724): Updates disabled for region testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:31,609 INFO [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(1838): Closed testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:31,609 DEBUG [RegionOpenAndInit-testRITStateForRollback-pool-0] regionserver.HRegion(1558): Region close journal for 864e1811adec64ed8b346b0fa5959647: 2023-07-11 18:47:31,611 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=95, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRITStateForRollback execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:31,612 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101251611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101251611"}]},"ts":"1689101251611"} 2023-07-11 18:47:31,613 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:31,613 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=95, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRITStateForRollback execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:31,614 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRITStateForRollback","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101251614"}]},"ts":"1689101251614"} 2023-07-11 18:47:31,615 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRITStateForRollback, state=ENABLING in hbase:meta 2023-07-11 18:47:31,618 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:31,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:31,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:31,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:31,619 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:31,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=96, ppid=95, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN}] 2023-07-11 18:47:31,621 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=96, ppid=95, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN 2023-07-11 18:47:31,622 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=96, ppid=95, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33849,1689101240752; forceNewPlan=false, retain=false 2023-07-11 18:47:31,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=95 2023-07-11 18:47:31,772 INFO [jenkins-hbase9:39147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:31,773 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=96 updating hbase:meta row=864e1811adec64ed8b346b0fa5959647, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:31,773 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101251773"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101251773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101251773"}]},"ts":"1689101251773"} 2023-07-11 18:47:31,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=97, ppid=96, state=RUNNABLE; OpenRegionProcedure 864e1811adec64ed8b346b0fa5959647, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:31,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=95 2023-07-11 18:47:31,928 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:31,928 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:31,929 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=AdminService 2023-07-11 18:47:31,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:31,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 864e1811adec64ed8b346b0fa5959647, NAME => 'testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:31,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRITStateForRollback 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:31,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,937 INFO [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,939 DEBUG [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf 2023-07-11 18:47:31,939 DEBUG [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf 2023-07-11 18:47:31,939 INFO [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 864e1811adec64ed8b346b0fa5959647 columnFamilyName cf 2023-07-11 18:47:31,940 INFO [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] regionserver.HStore(310): Store=864e1811adec64ed8b346b0fa5959647/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:31,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:31,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:31,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 864e1811adec64ed8b346b0fa5959647; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71478213, jitterRate=0.06510837376117706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:31,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 864e1811adec64ed8b346b0fa5959647: 2023-07-11 18:47:31,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647., pid=97, masterSystemTime=1689101251927 2023-07-11 18:47:31,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:31,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:31,953 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=96 updating hbase:meta row=864e1811adec64ed8b346b0fa5959647, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:31,953 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101251952"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101251952"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101251952"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101251952"}]},"ts":"1689101251952"} 2023-07-11 18:47:31,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=97, resume processing ppid=96 2023-07-11 18:47:31,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, ppid=96, state=SUCCESS; OpenRegionProcedure 864e1811adec64ed8b346b0fa5959647, server=jenkins-hbase9.apache.org,33849,1689101240752 in 179 msec 2023-07-11 18:47:31,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=96, resume processing ppid=95 2023-07-11 18:47:31,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, ppid=95, state=SUCCESS; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN in 337 msec 2023-07-11 18:47:31,958 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=95, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRITStateForRollback execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:31,958 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRITStateForRollback","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101251958"}]},"ts":"1689101251958"} 2023-07-11 18:47:31,959 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRITStateForRollback, state=ENABLED in hbase:meta 2023-07-11 18:47:31,961 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=95, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRITStateForRollback execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:31,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; CreateTableProcedure table=testRITStateForRollback in 378 msec 2023-07-11 18:47:32,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1230): Checking to see if procedure is done pid=95 2023-07-11 18:47:32,190 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRITStateForRollback, procId: 95 completed 2023-07-11 18:47:32,190 DEBUG [Listener at localhost/44535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRITStateForRollback get assigned. Timeout = 60000ms 2023-07-11 18:47:32,190 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:32,193 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3484): All regions for table testRITStateForRollback assigned to meta. Checking AM states. 2023-07-11 18:47:32,193 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:32,193 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3504): All regions for table testRITStateForRollback assigned. 2023-07-11 18:47:32,193 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:32,194 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:32,195 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:32,197 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:32,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:32,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure.ProcedureCoordinator(165): Submitting procedure testRITStateForRollback 2023-07-11 18:47:32,206 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRITStateForRollback' 2023-07-11 18:47:32,206 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:32,206 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRITStateForRollback' starting 'acquire' 2023-07-11 18:47:32,206 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRITStateForRollback', kicking off acquire phase on members. 2023-07-11 18:47:32,207 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,207 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,208 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:32,208 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:32,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:32,208 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:32,208 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:32,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:32,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:32,209 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,209 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRITStateForRollback' with timeout 60000ms 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRITStateForRollback' with timeout 60000ms 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRITStateForRollback' starting 'acquire' stage 2023-07-11 18:47:32,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRITStateForRollback 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRITStateForRollback' starting 'acquire' stage 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRITStateForRollback' with timeout 60000ms 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRITStateForRollback' locally acquired 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:32,211 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRITStateForRollback' starting 'acquire' stage 2023-07-11 18:47:32,211 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRITStateForRollback' locally acquired 2023-07-11 18:47:32,211 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testRITStateForRollback) in zk 2023-07-11 18:47:32,211 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. started... 2023-07-11 18:47:32,210 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testRITStateForRollback) in zk 2023-07-11 18:47:32,213 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 864e1811adec64ed8b346b0fa5959647 1/1 column families, dataSize=116 B heapSize=672 B 2023-07-11 18:47:32,215 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,215 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,216 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,216 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,216 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRITStateForRollback' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:32,216 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRITStateForRollback' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:32,224 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=8 (bloomFilter=false), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/.tmp/cf/8771ccf059bc4608b6fc484c5097c514 2023-07-11 18:47:32,231 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/.tmp/cf/8771ccf059bc4608b6fc484c5097c514 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514 2023-07-11 18:47:32,235 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514, entries=4, sequenceid=8, filesize=4.7 K 2023-07-11 18:47:32,236 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~116 B/116, heapSize ~656 B/656, currentSize=0 B/0 for 864e1811adec64ed8b346b0fa5959647 in 23ms, sequenceid=8, compaction requested=false 2023-07-11 18:47:32,236 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRITStateForRollback' 2023-07-11 18:47:32,237 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 864e1811adec64ed8b346b0fa5959647: 2023-07-11 18:47:32,237 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,237 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:32,237 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:32,237 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,237 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRITStateForRollback' locally acquired 2023-07-11 18:47:32,237 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testRITStateForRollback) in zk 2023-07-11 18:47:32,238 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,238 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:32,239 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,239 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRITStateForRollback' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:32,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRITStateForRollback 2023-07-11 18:47:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:32,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure 'testRITStateForRollback' on coordinator 2023-07-11 18:47:32,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2201c8[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:32,241 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRITStateForRollback' starting 'in-barrier' execution. 2023-07-11 18:47:32,241 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRITStateForRollback' received 'reached' from coordinator. 2023-07-11 18:47:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRITStateForRollback' locally completed 2023-07-11 18:47:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRITStateForRollback' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRITStateForRollback' received 'reached' from coordinator. 2023-07-11 18:47:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRITStateForRollback' locally completed 2023-07-11 18:47:32,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,245 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRITStateForRollback' received 'reached' from coordinator. 2023-07-11 18:47:32,245 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRITStateForRollback' locally completed 2023-07-11 18:47:32,246 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRITStateForRollback' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:32,245 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRITStateForRollback' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:32,248 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRITStateForRollback' has notified controller of completion 2023-07-11 18:47:32,248 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:32,248 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRITStateForRollback' completed. 2023-07-11 18:47:32,249 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRITStateForRollback' has notified controller of completion 2023-07-11 18:47:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRITStateForRollback' has notified controller of completion 2023-07-11 18:47:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRITStateForRollback' completed. 2023-07-11 18:47:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:32,249 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRITStateForRollback' completed. 2023-07-11 18:47:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRITStateForRollback 2023-07-11 18:47:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:32,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRITStateForRollback 2023-07-11 18:47:32,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRITStateForRollback' member 'jenkins-hbase9.apache.org,33849,1689101240752': 2023-07-11 18:47:32,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' released barrier for procedure'testRITStateForRollback', counting down latch. Waiting for 0 more 2023-07-11 18:47:32,252 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRITStateForRollback' execution completed 2023-07-11 18:47:32,252 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:32,252 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:32,252 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRITStateForRollback 2023-07-11 18:47:32,252 INFO [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRITStateForRollbackincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:32,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:32,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:32,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:32,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:32,255 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:32,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,254 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:32,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRITStateForRollback 2023-07-11 18:47:32,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:32,259 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,260 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRITStateForRollback 2023-07-11 18:47:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:32,261 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRITStateForRollback 2023-07-11 18:47:32,262 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,262 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRITStateForRollback 2023-07-11 18:47:32,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:32,265 DEBUG [(jenkins-hbase9.apache.org,39147,1689101243678)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:32,266 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:32,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRITStateForRollback' 2023-07-11 18:47:32,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:32,265 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:32,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:32,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:32,266 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,266 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:32,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:32,266 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRITStateForRollback'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:32,266 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,266 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:32,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:32,266 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRITStateForRollback 2023-07-11 18:47:32,267 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRITStateForRollback 2023-07-11 18:47:32,367 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:32,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:32,371 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:32,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=false 2023-07-11 18:47:32,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testRITStateForRollback, parent=864e1811adec64ed8b346b0fa5959647, daughterA=254c193e209fc1e92d37030345a9700f, daughterB=b15cc040ddc70423471a965482842fb6 2023-07-11 18:47:32,379 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testRITStateForRollback, parent=864e1811adec64ed8b346b0fa5959647, daughterA=254c193e209fc1e92d37030345a9700f, daughterB=b15cc040ddc70423471a965482842fb6 2023-07-11 18:47:32,379 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testRITStateForRollback, parent=864e1811adec64ed8b346b0fa5959647, daughterA=254c193e209fc1e92d37030345a9700f, daughterB=b15cc040ddc70423471a965482842fb6 2023-07-11 18:47:32,379 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testRITStateForRollback, parent=864e1811adec64ed8b346b0fa5959647, daughterA=254c193e209fc1e92d37030345a9700f, daughterB=b15cc040ddc70423471a965482842fb6 2023-07-11 18:47:32,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=99, ppid=98, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, UNASSIGN}] 2023-07-11 18:47:32,383 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=98, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, UNASSIGN 2023-07-11 18:47:32,384 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=864e1811adec64ed8b346b0fa5959647, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,384 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101252384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101252384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101252384"}]},"ts":"1689101252384"} 2023-07-11 18:47:32,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE; CloseRegionProcedure 864e1811adec64ed8b346b0fa5959647, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:32,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 864e1811adec64ed8b346b0fa5959647, disabling compactions & flushes 2023-07-11 18:47:32,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. after waiting 0 ms 2023-07-11 18:47:32,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2023-07-11 18:47:32,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 864e1811adec64ed8b346b0fa5959647: 2023-07-11 18:47:32,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,545 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=864e1811adec64ed8b346b0fa5959647, regionState=CLOSED 2023-07-11 18:47:32,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101252545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101252545"}]},"ts":"1689101252545"} 2023-07-11 18:47:32,547 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-11 18:47:32,547 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; CloseRegionProcedure 864e1811adec64ed8b346b0fa5959647, server=jenkins-hbase9.apache.org,33849,1689101240752 in 161 msec 2023-07-11 18:47:32,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=98 2023-07-11 18:47:32,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=98, state=SUCCESS; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, UNASSIGN in 166 msec 2023-07-11 18:47:32,556 INFO [PEWorker-5] assignment.SplitTableRegionProcedure(694): pid=98 splitting 1 storefiles, region=864e1811adec64ed8b346b0fa5959647, threads=1 2023-07-11 18:47:32,557 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=98 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514 for region: 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,564 DEBUG [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514, top=true 2023-07-11 18:47:32,568 INFO [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/.splits/b15cc040ddc70423471a965482842fb6/cf/testRITStateForRollback=864e1811adec64ed8b346b0fa5959647-8771ccf059bc4608b6fc484c5097c514 for child: b15cc040ddc70423471a965482842fb6, parent: 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,568 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=98 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514 for region: 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,568 DEBUG [PEWorker-5] assignment.SplitTableRegionProcedure(755): pid=98 split storefiles for region 864e1811adec64ed8b346b0fa5959647 Daughter A: 0 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:32,594 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/254c193e209fc1e92d37030345a9700f/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=-1 2023-07-11 18:47:32,596 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/b15cc040ddc70423471a965482842fb6/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=-1 2023-07-11 18:47:32,597 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(229): Waiting for region to come out of RIT 2023-07-11 18:47:32,597 ERROR [PEWorker-5] assignment.SplitTableRegionProcedure(347): Splitting 864e1811adec64ed8b346b0fa5959647, pid=98, state=RUNNABLE:SPLIT_TABLE_REGION_PRE_OPERATION_BEFORE_META, locked=true; SplitTableRegionProcedure table=testRITStateForRollback, parent=864e1811adec64ed8b346b0fa5959647, daughterA=254c193e209fc1e92d37030345a9700f, daughterB=b15cc040ddc70423471a965482842fb6 java.io.IOException: Causing rollback of region split at org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster$FailingSplitMasterObserver.preSplitRegionBeforeMETAAction(TestSplitTransactionOnCluster.java:488) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$61.call(MasterCoprocessorHost.java:822) at org.apache.hadoop.hbase.master.MasterCoprocessorHost$61.call(MasterCoprocessorHost.java:819) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:558) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:631) at org.apache.hadoop.hbase.master.MasterCoprocessorHost.preSplitBeforeMETAAction(MasterCoprocessorHost.java:819) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.preSplitRegionBeforeMETA(SplitTableRegionProcedure.java:829) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.executeFromState(SplitTableRegionProcedure.java:320) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.executeFromState(SplitTableRegionProcedure.java:94) at org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:188) at org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:922) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1646) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeProcedure(ProcedureExecutor.java:1392) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$1100(ProcedureExecutor.java:73) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$WorkerThread.run(ProcedureExecutor.java:1964) 2023-07-11 18:47:32,611 DEBUG [PEWorker-5] procedure2.ProcedureExecutor(1054): Stored [pid=101, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN] 2023-07-11 18:47:32,612 INFO [PEWorker-2] procedure.MasterProcedureScheduler(718): Waiting on xlock for pid=101, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN held by pid=98 2023-07-11 18:47:32,613 DEBUG [PEWorker-2] procedure2.ProcedureExecutor(1400): LOCK_EVENT_WAIT pid=101, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN 2023-07-11 18:47:32,618 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN 2023-07-11 18:47:32,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1528): Rolled back pid=98, state=ROLLEDBACK, exception=java.io.IOException via master-split-regions:java.io.IOException: Causing rollback of region split; SplitTableRegionProcedure table=testRITStateForRollback, parent=864e1811adec64ed8b346b0fa5959647, daughterA=254c193e209fc1e92d37030345a9700f, daughterB=b15cc040ddc70423471a965482842fb6 exec-time=239 msec 2023-07-11 18:47:32,619 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=101, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN; state=CLOSED, location=jenkins-hbase9.apache.org,33849,1689101240752; forceNewPlan=false, retain=true 2023-07-11 18:47:32,769 INFO [jenkins-hbase9:39147] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:32,769 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=864e1811adec64ed8b346b0fa5959647, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,769 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101252769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101252769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101252769"}]},"ts":"1689101252769"} 2023-07-11 18:47:32,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; OpenRegionProcedure 864e1811adec64ed8b346b0fa5959647, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:32,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 864e1811adec64ed8b346b0fa5959647, NAME => 'testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRITStateForRollback 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,927 INFO [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,928 DEBUG [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf 2023-07-11 18:47:32,928 DEBUG [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf 2023-07-11 18:47:32,928 INFO [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 864e1811adec64ed8b346b0fa5959647 columnFamilyName cf 2023-07-11 18:47:32,934 DEBUG [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514 2023-07-11 18:47:32,934 INFO [StoreOpener-864e1811adec64ed8b346b0fa5959647-1] regionserver.HStore(310): Store=864e1811adec64ed8b346b0fa5959647/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:32,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(602): Cleaned up old failed split transaction detritus: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/.splits 2023-07-11 18:47:32,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:32,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 864e1811adec64ed8b346b0fa5959647; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74370273, jitterRate=0.10820342600345612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:32,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 864e1811adec64ed8b346b0fa5959647: 2023-07-11 18:47:32,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647., pid=102, masterSystemTime=1689101252922 2023-07-11 18:47:32,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:32,943 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=864e1811adec64ed8b346b0fa5959647, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:32,943 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101252943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101252943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101252943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101252943"}]},"ts":"1689101252943"} 2023-07-11 18:47:32,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-11 18:47:32,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; OpenRegionProcedure 864e1811adec64ed8b346b0fa5959647, server=jenkins-hbase9.apache.org,33849,1689101240752 in 173 msec 2023-07-11 18:47:32,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, state=SUCCESS; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN in 336 msec 2023-07-11 18:47:32,999 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:33,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39147] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=true 2023-07-11 18:47:33,000 INFO [Listener at localhost/44535] hbase.MiniHBaseCluster(607): Aborting jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:33,000 ERROR [Listener at localhost/44535] helpers.MarkerIgnoringBase(143): Master server abort: loaded coprocessors are: [org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster$FailingSplitMasterObserver, org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2023-07-11 18:47:33,000 ERROR [Listener at localhost/44535] helpers.MarkerIgnoringBase(159): ***** ABORTING master jenkins-hbase9.apache.org,39147,1689101243678: Aborting for tests ***** java.lang.Exception: Trace info at org.apache.hadoop.hbase.MiniHBaseCluster.abortMaster(MiniHBaseCluster.java:608) at org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster.abortAndWaitForMaster(TestSplitTransactionOnCluster.java:999) at org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster.testRITStateForRollback(TestSplitTransactionOnCluster.java:237) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:33,001 DEBUG [Listener at localhost/44535] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster$FailingSplitMasterObserver 2023-07-11 18:47:33,001 INFO [Listener at localhost/44535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39147,1689101243678' ***** 2023-07-11 18:47:33,001 INFO [Listener at localhost/44535] regionserver.HRegionServer(2311): STOPPED: Stopped by Listener at localhost/44535 2023-07-11 18:47:33,003 DEBUG [M:0;jenkins-hbase9:39147] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c8886c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:47:33,003 INFO [M:0;jenkins-hbase9:39147] regionserver.HRegionServer(1141): aborting server jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:33,003 DEBUG [M:0;jenkins-hbase9:39147] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0190416f to 127.0.0.1:62848 2023-07-11 18:47:33,003 DEBUG [M:0;jenkins-hbase9:39147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:47:33,003 INFO [M:0;jenkins-hbase9:39147] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39147,1689101243678; all regions closed. 2023-07-11 18:47:33,003 DEBUG [M:0;jenkins-hbase9:39147] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:47:33,003 DEBUG [M:0;jenkins-hbase9:39147] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 18:47:33,003 DEBUG [M:0;jenkins-hbase9:39147] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 18:47:33,003 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101243943] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101243943,5,FailOnTimeoutGroup] 2023-07-11 18:47:33,004 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101243945] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101243945,5,FailOnTimeoutGroup] 2023-07-11 18:47:33,004 INFO [M:0;jenkins-hbase9:39147] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 18:47:33,004 INFO [M:0;jenkins-hbase9:39147] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 18:47:33,003 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 18:47:33,004 INFO [M:0;jenkins-hbase9:39147] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-11 18:47:33,004 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:33,004 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:33,004 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(360): Waiting on jenkins-hbase9.apache.org,39147,1689101243678 2023-07-11 18:47:33,004 DEBUG [M:0;jenkins-hbase9:39147] master.HMaster(1512): Stopping service threads 2023-07-11 18:47:33,004 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:33,004 INFO [M:0;jenkins-hbase9:39147] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 18:47:33,004 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:33,004 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:33,004 INFO [M:0;jenkins-hbase9:39147] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:47:33,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:33,005 ERROR [M:0;jenkins-hbase9:39147] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:47:33,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:33,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:33,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:33,005 INFO [M:0;jenkins-hbase9:39147] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=true 2023-07-11 18:47:33,005 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 18:47:33,006 DEBUG [M:0;jenkins-hbase9:39147] zookeeper.ZKUtil(398): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 18:47:33,006 WARN [M:0;jenkins-hbase9:39147] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 18:47:33,006 INFO [M:0;jenkins-hbase9:39147] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:47:33,006 INFO [M:0;jenkins-hbase9:39147] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=true 2023-07-11 18:47:33,010 DEBUG [M:0;jenkins-hbase9:39147] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 18:47:33,010 INFO [M:0;jenkins-hbase9:39147] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:33,010 DEBUG [M:0;jenkins-hbase9:39147] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:33,010 DEBUG [M:0;jenkins-hbase9:39147] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 18:47:33,010 DEBUG [M:0;jenkins-hbase9:39147] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:33,011 ERROR [M:0;jenkins-hbase9:39147] regionserver.HRegion(1825): Memstore data size is 193613 in region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:33,011 INFO [M:0;jenkins-hbase9:39147] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:47:33,011 DEBUG [M:0;jenkins-hbase9:39147] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:47:33,011 INFO [M:0;jenkins-hbase9:39147] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 18:47:33,011 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:47:33,012 INFO [M:0;jenkins-hbase9:39147] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39147 2023-07-11 18:47:33,015 DEBUG [M:0;jenkins-hbase9:39147] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,39147,1689101243678 already deleted, retry=false 2023-07-11 18:47:33,091 WARN [RS-EventLoopGroup-5-2] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:39147 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:39147 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:33,091 DEBUG [RS-EventLoopGroup-5-2] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:39147 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:39147 2023-07-11 18:47:33,092 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(2738): No master found; retry 2023-07-11 18:47:33,111 WARN [RS-EventLoopGroup-5-3] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:39147 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:39147 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:33,112 DEBUG [RS-EventLoopGroup-5-3] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:39147 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:39147 2023-07-11 18:47:33,112 WARN [RS-EventLoopGroup-7-3] ipc.NettyRpcConnection$2(294): Exception encountered while connecting to the server jenkins-hbase9.apache.org/172.31.2.10:39147 org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:39147 Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.newConnectException0(Errors.java:155) at org.apache.hbase.thirdparty.io.netty.channel.unix.Errors.handleConnectErrno(Errors.java:128) at org.apache.hbase.thirdparty.io.netty.channel.unix.Socket.finishConnect(Socket.java:359) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:710) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:687) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 18:47:33,112 DEBUG [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(2738): No master found; retry 2023-07-11 18:47:33,113 DEBUG [RS-EventLoopGroup-7-3] ipc.FailedServers(52): Added failed server with address jenkins-hbase9.apache.org/172.31.2.10:39147 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: jenkins-hbase9.apache.org/172.31.2.10:39147 2023-07-11 18:47:33,113 DEBUG [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(2738): No master found; retry 2023-07-11 18:47:33,205 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:47:33,205 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:39147-0x10155a8225f000b, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:47:33,205 INFO [M:0;jenkins-hbase9:39147] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39147,1689101243678; zookeeper connection closed. 2023-07-11 18:47:33,218 INFO [Listener at localhost/44535] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-11 18:47:33,219 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:33,219 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:33,219 INFO [Listener at localhost/44535] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 18:47:33,219 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 18:47:33,219 INFO [Listener at localhost/44535] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 18:47:33,219 INFO [Listener at localhost/44535] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 18:47:33,220 INFO [Listener at localhost/44535] ipc.NettyRpcServer(120): Bind to /172.31.2.10:36851 2023-07-11 18:47:33,221 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:33,222 INFO [Listener at localhost/44535] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:33,223 INFO [Listener at localhost/44535] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36851 connecting to ZooKeeper ensemble=127.0.0.1:62848 2023-07-11 18:47:33,226 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:368510x0, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 18:47:33,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36851-0x10155a8225f000e connected 2023-07-11 18:47:33,231 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:47:33,231 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/running 2023-07-11 18:47:33,233 DEBUG [Listener at localhost/44535] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 18:47:33,233 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36851 2023-07-11 18:47:33,233 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36851 2023-07-11 18:47:33,233 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36851 2023-07-11 18:47:33,234 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36851 2023-07-11 18:47:33,234 DEBUG [Listener at localhost/44535] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36851 2023-07-11 18:47:33,234 INFO [Listener at localhost/44535] master.HMaster(444): hbase.rootdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a, hbase.cluster.distributed=false 2023-07-11 18:47:33,235 DEBUG [pool-380-thread-1] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: INIT 2023-07-11 18:47:33,236 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:47:33,239 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 18:47:33,239 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:47:33,241 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:33,241 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:33,241 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:33,241 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:47:33,241 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 18:47:33,242 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:47:33,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 18:47:33,242 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,36851,1689101253218 from backup master directory 2023-07-11 18:47:33,242 INFO [M:0;jenkins-hbase9:36851] regionserver.HRegionServer(951): ClusterId : 48047c0c-16f7-44b9-ae0d-0731457ba822 2023-07-11 18:47:33,243 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:47:33,243 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 18:47:33,243 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 18:47:33,243 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:47:33,256 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 18:47:33,277 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6352e726 to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:33,283 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b31a1da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:33,283 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:33,284 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 18:47:33,284 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 18:47:33,288 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(288): Renamed hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678-dead as it is dead 2023-07-11 18:47:33,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] util.RecoverLeaseFSUtils(86): Recover lease on dfs file hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678-dead/jenkins-hbase9.apache.org%2C39147%2C1689101243678.1689101243785 2023-07-11 18:47:33,289 INFO [master/jenkins-hbase9:0:becomeActiveMaster] util.RecoverLeaseFSUtils(175): Recovered lease, attempt=0 on file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678-dead/jenkins-hbase9.apache.org%2C39147%2C1689101243678.1689101243785 after 0ms 2023-07-11 18:47:33,290 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(300): Renamed hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678-dead/jenkins-hbase9.apache.org%2C39147%2C1689101243678.1689101243785 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase9.apache.org%2C39147%2C1689101243678.1689101243785 2023-07-11 18:47:33,290 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(302): Delete empty local region wal dir hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,39147,1689101243678-dead 2023-07-11 18:47:33,290 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:47:33,292 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C36851%2C1689101253218, suffix=, logDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,36851,1689101253218, archiveDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/oldWALs, maxLogs=10 2023-07-11 18:47:33,307 DEBUG [RS-EventLoopGroup-9-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK] 2023-07-11 18:47:33,307 DEBUG [RS-EventLoopGroup-9-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK] 2023-07-11 18:47:33,307 DEBUG [RS-EventLoopGroup-9-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK] 2023-07-11 18:47:33,309 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,36851,1689101253218/jenkins-hbase9.apache.org%2C36851%2C1689101253218.1689101253292 2023-07-11 18:47:33,310 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34695,DS-a564deb8-c4ce-46b6-8876-9ca7b3b343e6,DISK], DatanodeInfoWithStorage[127.0.0.1:37275,DS-ce174cc4-c1b8-44c8-b8b8-a6157729a3b6,DISK], DatanodeInfoWithStorage[127.0.0.1:39985,DS-6cb48b31-2aae-40e3-b604-978ba45a3921,DISK]] 2023-07-11 18:47:33,310 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:33,310 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:33,310 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:33,310 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:33,312 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:33,313 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 18:47:33,313 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 18:47:33,318 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/01a92f6468964ebcbae9325df6cd20e7 2023-07-11 18:47:33,318 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:33,318 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5179): Found 1 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals 2023-07-11 18:47:33,319 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5276): Replaying edits from hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase9.apache.org%2C39147%2C1689101243678.1689101243785 2023-07-11 18:47:33,327 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5464): Applied 431, skipped 0, firstSequenceIdInLog=445, maxSequenceIdInLog=809, path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase9.apache.org%2C39147%2C1689101243678.1689101243785 2023-07-11 18:47:33,327 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=189.08 KB heapSize=221.29 KB 2023-07-11 18:47:33,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=189.08 KB at sequenceid=809 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c86e7974d3549eb9479307bd856b464 2023-07-11 18:47:33,341 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c86e7974d3549eb9479307bd856b464 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c86e7974d3549eb9479307bd856b464 2023-07-11 18:47:33,345 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c86e7974d3549eb9479307bd856b464, entries=431, sequenceid=809, filesize=195.3 K 2023-07-11 18:47:33,345 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(2948): Finished flush of dataSize ~189.08 KB/193613, heapSize ~221.27 KB/226584, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=809, compaction requested=false; wal=null 2023-07-11 18:47:33,346 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5086): Deleted recovered.edits file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals/jenkins-hbase9.apache.org%2C39147%2C1689101243678.1689101243785 2023-07-11 18:47:33,348 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 18:47:33,350 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/809.seqid, newMaxSeqId=809, maxSeqId=443 2023-07-11 18:47:33,351 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=810; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75338360, jitterRate=0.12262904644012451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:33,351 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:47:33,351 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 18:47:33,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 18:47:33,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 18:47:33,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 18:47:33,353 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-07-11 18:47:33,368 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta 2023-07-11 18:47:33,368 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace 2023-07-11 18:47:33,369 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default 2023-07-11 18:47:33,369 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase 2023-07-11 18:47:33,369 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=9, state=SUCCESS; CreateTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:33,370 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=12, state=SUCCESS; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=ff13f8e1c63474defaefc7d45bc4b08a, daughterA=d110326d2f5fcd1365b84bd9c1da91a4, daughterB=383e6bcb64774cf6ef214b50782ac346 2023-07-11 18:47:33,370 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=19, state=SUCCESS; SplitTableRegionProcedure table=testShutdownFixupWhenDaughterHasSplit, parent=383e6bcb64774cf6ef214b50782ac346, daughterA=46fcc7cc8626607b76b2955038597ba6, daughterB=613b8f43341489d942acf5814ba6a43b 2023-07-11 18:47:33,370 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=26, state=SUCCESS; DisableTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:33,370 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=33, state=SUCCESS; ServerCrashProcedure jenkins-hbase9.apache.org,41081,1689101231767, splitWal=true, meta=false 2023-07-11 18:47:33,370 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=42, state=SUCCESS; DeleteTableProcedure table=testShutdownFixupWhenDaughterHasSplit 2023-07-11 18:47:33,370 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=43, state=SUCCESS; CreateTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:33,371 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=46, state=SUCCESS; TransitRegionStateProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c, REOPEN/MOVE 2023-07-11 18:47:33,371 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=49, state=SUCCESS; SplitTableRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, parent=1a043584b185b695c44ad7c0f652836c, daughterA=22be79dbd2c59d446651c6f009aeee63, daughterB=8839cd6364743d0ae1f1090faca02423 2023-07-11 18:47:33,371 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=56, state=SUCCESS; GCRegionProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor, region=1a043584b185b695c44ad7c0f652836c 2023-07-11 18:47:33,371 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=57, state=SUCCESS; DisableTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:33,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=62, state=SUCCESS; DeleteTableProcedure table=testMasterRestartAtRegionSplitPendingCatalogJanitor 2023-07-11 18:47:33,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=63, state=SUCCESS; CreateTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:33,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=66, state=SUCCESS; SplitTableRegionProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles, parent=d5e64bf2fd2e5c458f152aa35d000fb1, daughterA=9a6461924e1cac9cba18e02dc09c9189, daughterB=3a1940ecd93b7c6a3b196c97cadecbb6 2023-07-11 18:47:33,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=73, state=SUCCESS; DisableTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:33,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=78, state=SUCCESS; DeleteTableProcedure table=testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles 2023-07-11 18:47:33,373 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=79, state=SUCCESS; CreateTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:33,373 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=82, state=SUCCESS; SplitTableRegionProcedure table=testSplitFailedCompactionAndSplit, parent=b7a313a1fe91c1be479ca52dccffaed5, daughterA=58ff9798160037433aff3914405d3ea1, daughterB=f2a2d598705454a709d7057c7f772c3a 2023-07-11 18:47:33,373 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=89, state=SUCCESS; DisableTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:33,373 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=94, state=SUCCESS; DeleteTableProcedure table=testSplitFailedCompactionAndSplit 2023-07-11 18:47:33,374 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=95, state=SUCCESS; CreateTableProcedure table=testRITStateForRollback 2023-07-11 18:47:33,374 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=98, state=ROLLEDBACK, exception=java.io.IOException via master-split-regions:java.io.IOException: Causing rollback of region split; SplitTableRegionProcedure table=testRITStateForRollback, parent=864e1811adec64ed8b346b0fa5959647, daughterA=254c193e209fc1e92d37030345a9700f, daughterB=b15cc040ddc70423471a965482842fb6 2023-07-11 18:47:33,374 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(411): Completed pid=101, state=SUCCESS; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, ASSIGN 2023-07-11 18:47:33,374 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 21 msec 2023-07-11 18:47:33,374 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 18:47:33,375 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [meta-region-server] 2023-07-11 18:47:33,375 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(272): Loaded hbase:meta state=OPEN, location=jenkins-hbase9.apache.org,34803,1689101231723, table=hbase:meta, region=1588230740 2023-07-11 18:47:33,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 3 possibly 'live' servers, and 0 'splitting'. 2023-07-11 18:47:33,377 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:33,378 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:33,378 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:33,389 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 18:47:33,389 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 18:47:33,389 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/balancer 2023-07-11 18:47:33,390 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 18:47:33,390 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 18:47:33,391 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 18:47:33,391 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 18:47:33,392 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 18:47:33,392 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,36851,1689101253218, sessionid=0x10155a8225f000e, setting cluster-up flag (Was=true) 2023-07-11 18:47:33,393 DEBUG [RS:0;jenkins-hbase9:34803] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:33,394 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57185, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:33,394 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36851] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:546) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15954) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:33,394 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 18:47:33,395 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:47:33,398 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 18:47:33,398 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:47:33,399 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.hbase-snapshot/.tmp 2023-07-11 18:47:33,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:33,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:33,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:33,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-11 18:47:33,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-11 18:47:33,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:33,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-11 18:47:33,400 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-11 18:47:33,400 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689101283400 2023-07-11 18:47:33,400 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 18:47:33,400 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 18:47:33,401 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 18:47:33,401 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 18:47:33,401 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 18:47:33,401 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 18:47:33,401 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,402 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 18:47:33,402 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 18:47:33,402 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 18:47:33,402 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 18:47:33,402 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 18:47:33,402 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101253402,5,FailOnTimeoutGroup] 2023-07-11 18:47:33,402 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101253402,5,FailOnTimeoutGroup] 2023-07-11 18:47:33,402 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,403 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 18:47:33,403 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,403 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,403 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689101253403, completionTime=-1 2023-07-11 18:47:33,403 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 18:47:33,403 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 18:47:33,404 DEBUG [hconnection-0x4023269e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:33,405 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=ClientService 2023-07-11 18:47:33,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=c3865dd83a85f157967ba62a780042b0, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,34803,1689101231723, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723, openSeqNum=2 2023-07-11 18:47:33,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.RegionStateStore(147): Load hbase:meta entry region=864e1811adec64ed8b346b0fa5959647, regionState=OPEN, lastHost=jenkins-hbase9.apache.org,33849,1689101240752, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752, openSeqNum=12 2023-07-11 18:47:33,408 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 18:47:33,409 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689101313408 2023-07-11 18:47:33,409 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689101373409 2023-07-11 18:47:33,409 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 5 msec 2023-07-11 18:47:33,413 DEBUG [RS:2;jenkins-hbase9:40505] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:33,414 DEBUG [RS:3;jenkins-hbase9:33849] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 18:47:33,414 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60173, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:33,414 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55289, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 18:47:33,421 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36851,1689101253218-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,421 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36851,1689101253218-BalancerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,421 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36851,1689101253218-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,422 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:36851, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,422 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 18:47:33,422 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/namespace 2023-07-11 18:47:33,424 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 18:47:33,429 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 18:47:33,435 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 18:47:33,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.192sec 2023-07-11 18:47:33,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 18:47:33,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 18:47:33,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 18:47:33,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36851,1689101253218-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 18:47:33,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,36851,1689101253218-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 18:47:33,436 INFO [Listener at localhost/44535] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 18:47:33,436 DEBUG [Listener at localhost/44535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39ca9d93 to 127.0.0.1:62848 2023-07-11 18:47:33,436 DEBUG [Listener at localhost/44535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:47:33,436 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(2939): Invalidated connection. Updating master addresses before: jenkins-hbase9.apache.org:39147 after: jenkins-hbase9.apache.org:36851 2023-07-11 18:47:33,437 DEBUG [Listener at localhost/44535] zookeeper.ReadOnlyZKClient(139): Connect 0x744bf7a0 to 127.0.0.1:62848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 18:47:33,437 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 18:47:33,443 DEBUG [Listener at localhost/44535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ada84f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 18:47:33,443 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 18:47:33,445 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 18:47:33,446 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testRITStateForRollback 2023-07-11 18:47:33,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testRITStateForRollback 2023-07-11 18:47:33,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=103, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRITStateForRollback 2023-07-11 18:47:33,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=103 2023-07-11 18:47:33,451 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRITStateForRollback","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101253451"}]},"ts":"1689101253451"} 2023-07-11 18:47:33,452 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRITStateForRollback, state=DISABLING in hbase:meta 2023-07-11 18:47:33,454 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testRITStateForRollback to state=DISABLING 2023-07-11 18:47:33,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=104, ppid=103, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, UNASSIGN}] 2023-07-11 18:47:33,457 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=104, ppid=103, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, UNASSIGN 2023-07-11 18:47:33,458 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=104 updating hbase:meta row=864e1811adec64ed8b346b0fa5959647, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:33,458 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101253458"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101253458"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101253458"}]},"ts":"1689101253458"} 2023-07-11 18:47:33,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=105, ppid=104, state=RUNNABLE; CloseRegionProcedure 864e1811adec64ed8b346b0fa5959647, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:33,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=103 2023-07-11 18:47:33,614 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:33,614 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:33,615 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=AdminService 2023-07-11 18:47:33,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:33,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 864e1811adec64ed8b346b0fa5959647, disabling compactions & flushes 2023-07-11 18:47:33,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:33,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:33,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. after waiting 0 ms 2023-07-11 18:47:33,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:33,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits/14.seqid, newMaxSeqId=14, maxSeqId=11 2023-07-11 18:47:33,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647. 2023-07-11 18:47:33,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 864e1811adec64ed8b346b0fa5959647: 2023-07-11 18:47:33,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:33,626 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=104 updating hbase:meta row=864e1811adec64ed8b346b0fa5959647, regionState=CLOSED 2023-07-11 18:47:33,626 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1689101253626"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101253626"}]},"ts":"1689101253626"} 2023-07-11 18:47:33,628 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=105, resume processing ppid=104 2023-07-11 18:47:33,628 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, ppid=104, state=SUCCESS; CloseRegionProcedure 864e1811adec64ed8b346b0fa5959647, server=jenkins-hbase9.apache.org,33849,1689101240752 in 168 msec 2023-07-11 18:47:33,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=104, resume processing ppid=103 2023-07-11 18:47:33,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, ppid=103, state=SUCCESS; TransitRegionStateProcedure table=testRITStateForRollback, region=864e1811adec64ed8b346b0fa5959647, UNASSIGN in 173 msec 2023-07-11 18:47:33,632 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRITStateForRollback","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101253632"}]},"ts":"1689101253632"} 2023-07-11 18:47:33,633 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRITStateForRollback, state=DISABLED in hbase:meta 2023-07-11 18:47:33,638 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testRITStateForRollback to state=DISABLED 2023-07-11 18:47:33,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, state=SUCCESS; DisableTableProcedure table=testRITStateForRollback in 193 msec 2023-07-11 18:47:33,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=103 2023-07-11 18:47:33,754 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRITStateForRollback, procId: 103 completed 2023-07-11 18:47:33,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testRITStateForRollback 2023-07-11 18:47:33,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=106, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRITStateForRollback 2023-07-11 18:47:33,757 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=106, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRITStateForRollback 2023-07-11 18:47:33,758 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=106, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRITStateForRollback 2023-07-11 18:47:33,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=106 2023-07-11 18:47:33,761 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:33,763 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits] 2023-07-11 18:47:33,766 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514 2023-07-11 18:47:33,768 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits/14.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits/14.seqid 2023-07-11 18:47:33,769 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 2023-07-11 18:47:33,769 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRITStateForRollback regions 2023-07-11 18:47:33,771 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=106, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRITStateForRollback 2023-07-11 18:47:33,773 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRITStateForRollback from hbase:meta 2023-07-11 18:47:33,775 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testRITStateForRollback' descriptor. 2023-07-11 18:47:33,778 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=106, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRITStateForRollback 2023-07-11 18:47:33,778 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testRITStateForRollback' from region states. 2023-07-11 18:47:33,778 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101253778"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:33,779 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 18:47:33,779 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 864e1811adec64ed8b346b0fa5959647, NAME => 'testRITStateForRollback,,1689101251583.864e1811adec64ed8b346b0fa5959647.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 18:47:33,779 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testRITStateForRollback' as deleted. 2023-07-11 18:47:33,779 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRITStateForRollback","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101253779"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:33,780 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testRITStateForRollback state from META 2023-07-11 18:47:33,782 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=106, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRITStateForRollback 2023-07-11 18:47:33,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, state=SUCCESS; DeleteTableProcedure table=testRITStateForRollback in 28 msec 2023-07-11 18:47:33,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=106 2023-07-11 18:47:33,859 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRITStateForRollback, procId: 106 completed 2023-07-11 18:47:33,882 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testRITStateForRollback Thread=433 (was 426) - Thread LEAK? -, OpenFileDescriptor=820 (was 818) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=263 (was 286), ProcessCount=170 (was 170), AvailableMemoryMB=7747 (was 7760) 2023-07-11 18:47:33,896 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testSplitRollbackOnRegionClosing Thread=433, OpenFileDescriptor=820, MaxFileDescriptor=60000, SystemLoadAverage=263, ProcessCount=170, AvailableMemoryMB=7746 2023-07-11 18:47:33,896 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:33,896 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:33,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testSplitRollbackOnRegionClosing', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:33,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=107, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:33,901 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=107, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testSplitRollbackOnRegionClosing execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:33,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testSplitRollbackOnRegionClosing" procId is: 107 2023-07-11 18:47:33,902 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=107, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testSplitRollbackOnRegionClosing execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:33,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=107 2023-07-11 18:47:33,903 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:33,904 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 empty. 2023-07-11 18:47:33,904 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:33,904 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testSplitRollbackOnRegionClosing regions 2023-07-11 18:47:33,917 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:33,918 INFO [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(7675): creating {ENCODED => a4240b09888f2c679a6d53d3ba64e5d8, NAME => 'testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testSplitRollbackOnRegionClosing', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:33,926 DEBUG [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(866): Instantiated testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:33,926 DEBUG [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(1604): Closing a4240b09888f2c679a6d53d3ba64e5d8, disabling compactions & flushes 2023-07-11 18:47:33,926 INFO [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(1626): Closing region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:33,926 DEBUG [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:33,926 DEBUG [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(1714): Acquired close lock on testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. after waiting 0 ms 2023-07-11 18:47:33,926 DEBUG [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(1724): Updates disabled for region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:33,926 INFO [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(1838): Closed testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:33,926 DEBUG [RegionOpenAndInit-testSplitRollbackOnRegionClosing-pool-0] regionserver.HRegion(1558): Region close journal for a4240b09888f2c679a6d53d3ba64e5d8: 2023-07-11 18:47:33,928 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=107, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testSplitRollbackOnRegionClosing execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:33,929 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101253929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101253929"}]},"ts":"1689101253929"} 2023-07-11 18:47:33,930 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:33,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=107, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testSplitRollbackOnRegionClosing execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:33,931 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitRollbackOnRegionClosing","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101253931"}]},"ts":"1689101253931"} 2023-07-11 18:47:33,932 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitRollbackOnRegionClosing, state=ENABLING in hbase:meta 2023-07-11 18:47:33,936 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:33,936 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:33,936 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:33,936 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:33,936 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:33,936 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, ASSIGN}] 2023-07-11 18:47:33,938 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=107, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, ASSIGN 2023-07-11 18:47:33,939 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=107, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:34,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=107 2023-07-11 18:47:34,089 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:34,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a4240b09888f2c679a6d53d3ba64e5d8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:34,091 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101254090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101254090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101254090"}]},"ts":"1689101254090"} 2023-07-11 18:47:34,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure a4240b09888f2c679a6d53d3ba64e5d8, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:34,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=107 2023-07-11 18:47:34,245 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:34,245 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:34,246 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=AdminService 2023-07-11 18:47:34,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4240b09888f2c679a6d53d3ba64e5d8, NAME => 'testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:34,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitRollbackOnRegionClosing a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:34,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,254 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,255 DEBUG [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info 2023-07-11 18:47:34,255 DEBUG [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info 2023-07-11 18:47:34,255 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4240b09888f2c679a6d53d3ba64e5d8 columnFamilyName info 2023-07-11 18:47:34,256 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] regionserver.HStore(310): Store=a4240b09888f2c679a6d53d3ba64e5d8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:34,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:34,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a4240b09888f2c679a6d53d3ba64e5d8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61397299, jitterRate=-0.08510895073413849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:34,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a4240b09888f2c679a6d53d3ba64e5d8: 2023-07-11 18:47:34,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8., pid=109, masterSystemTime=1689101254245 2023-07-11 18:47:34,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,264 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a4240b09888f2c679a6d53d3ba64e5d8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:34,264 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101254264"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101254264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101254264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101254264"}]},"ts":"1689101254264"} 2023-07-11 18:47:34,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-07-11 18:47:34,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure a4240b09888f2c679a6d53d3ba64e5d8, server=jenkins-hbase9.apache.org,34803,1689101231723 in 174 msec 2023-07-11 18:47:34,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-11 18:47:34,269 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, ASSIGN in 331 msec 2023-07-11 18:47:34,270 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=107, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testSplitRollbackOnRegionClosing execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:34,270 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitRollbackOnRegionClosing","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101254270"}]},"ts":"1689101254270"} 2023-07-11 18:47:34,271 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testSplitRollbackOnRegionClosing, state=ENABLED in hbase:meta 2023-07-11 18:47:34,274 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=107, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testSplitRollbackOnRegionClosing execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:34,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, state=SUCCESS; CreateTableProcedure table=testSplitRollbackOnRegionClosing in 375 msec 2023-07-11 18:47:34,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=107 2023-07-11 18:47:34,506 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testSplitRollbackOnRegionClosing, procId: 107 completed 2023-07-11 18:47:34,507 DEBUG [Listener at localhost/44535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testSplitRollbackOnRegionClosing get assigned. Timeout = 60000ms 2023-07-11 18:47:34,507 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:34,510 DEBUG [hconnection-0x3324104a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:34,512 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:34,514 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3484): All regions for table testSplitRollbackOnRegionClosing assigned to meta. Checking AM states. 2023-07-11 18:47:34,514 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:34,514 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3504): All regions for table testSplitRollbackOnRegionClosing assigned. 2023-07-11 18:47:34,514 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:34,514 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:34,515 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1032): MetaRegionServer=jenkins-hbase9.apache.org,34803,1689101231723, other=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:34,515 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1038): Moving testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. from jenkins-hbase9.apache.org,34803,1689101231723 to jenkins-hbase9.apache.org,40505,1689101231800; metaServerIndex=0 2023-07-11 18:47:34,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:34,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:34,516 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=AdminService 2023-07-11 18:47:34,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.RSRpcServices(2149): Warmup testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(7956): Warmup {ENCODED => a4240b09888f2c679a6d53d3ba64e5d8, NAME => 'testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:34,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(866): Instantiated testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:34,520 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,521 DEBUG [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info 2023-07-11 18:47:34,521 DEBUG [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info 2023-07-11 18:47:34,521 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4240b09888f2c679a6d53d3ba64e5d8 columnFamilyName info 2023-07-11 18:47:34,522 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] regionserver.HStore(310): Store=a4240b09888f2c679a6d53d3ba64e5d8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:34,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1604): Closing a4240b09888f2c679a6d53d3ba64e5d8, disabling compactions & flushes 2023-07-11 18:47:34,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1626): Closing region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1714): Acquired close lock on testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. after waiting 0 ms 2023-07-11 18:47:34,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1724): Updates disabled for region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1838): Closed testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(1558): Region close journal for a4240b09888f2c679a6d53d3ba64e5d8: 2023-07-11 18:47:34,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster(2072): Client=jenkins//172.31.2.10 move hri=a4240b09888f2c679a6d53d3ba64e5d8, source=jenkins-hbase9.apache.org,34803,1689101231723, destination=jenkins-hbase9.apache.org,40505,1689101231800, running balancer 2023-07-11 18:47:34,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, REOPEN/MOVE 2023-07-11 18:47:34,524 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=110, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, REOPEN/MOVE 2023-07-11 18:47:34,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=110 updating hbase:meta row=a4240b09888f2c679a6d53d3ba64e5d8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:34,525 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101254525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101254525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101254525"}]},"ts":"1689101254525"} 2023-07-11 18:47:34,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=110, state=RUNNABLE; CloseRegionProcedure a4240b09888f2c679a6d53d3ba64e5d8, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:34,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureSyncWait(216): waitFor pid=110 2023-07-11 18:47:34,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a4240b09888f2c679a6d53d3ba64e5d8, disabling compactions & flushes 2023-07-11 18:47:34,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. after waiting 0 ms 2023-07-11 18:47:34,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:47:34,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a4240b09888f2c679a6d53d3ba64e5d8: 2023-07-11 18:47:34,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3513): Adding a4240b09888f2c679a6d53d3ba64e5d8 move to jenkins-hbase9.apache.org,40505,1689101231800 record at close sequenceid=2 2023-07-11 18:47:34,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,686 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=110 updating hbase:meta row=a4240b09888f2c679a6d53d3ba64e5d8, regionState=CLOSED 2023-07-11 18:47:34,686 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101254686"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101254686"}]},"ts":"1689101254686"} 2023-07-11 18:47:34,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=110 2023-07-11 18:47:34,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=110, state=SUCCESS; CloseRegionProcedure a4240b09888f2c679a6d53d3ba64e5d8, server=jenkins-hbase9.apache.org,34803,1689101231723 in 162 msec 2023-07-11 18:47:34,690 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=110, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:34,840 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:34,840 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=110 updating hbase:meta row=a4240b09888f2c679a6d53d3ba64e5d8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:34,840 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101254840"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101254840"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101254840"}]},"ts":"1689101254840"} 2023-07-11 18:47:34,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=112, ppid=110, state=RUNNABLE; OpenRegionProcedure a4240b09888f2c679a6d53d3ba64e5d8, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:34,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:34,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4240b09888f2c679a6d53d3ba64e5d8, NAME => 'testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:34,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitRollbackOnRegionClosing a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:34,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:34,999 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:35,000 DEBUG [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info 2023-07-11 18:47:35,000 DEBUG [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info 2023-07-11 18:47:35,000 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4240b09888f2c679a6d53d3ba64e5d8 columnFamilyName info 2023-07-11 18:47:35,001 INFO [StoreOpener-a4240b09888f2c679a6d53d3ba64e5d8-1] regionserver.HStore(310): Store=a4240b09888f2c679a6d53d3ba64e5d8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:35,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:35,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:35,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:35,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a4240b09888f2c679a6d53d3ba64e5d8; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63509784, jitterRate=-0.05363047122955322}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:35,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a4240b09888f2c679a6d53d3ba64e5d8: 2023-07-11 18:47:35,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8., pid=112, masterSystemTime=1689101254994 2023-07-11 18:47:35,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:35,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:35,008 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=110 updating hbase:meta row=a4240b09888f2c679a6d53d3ba64e5d8, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:35,009 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101255008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101255008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101255008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101255008"}]},"ts":"1689101255008"} 2023-07-11 18:47:35,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=112, resume processing ppid=110 2023-07-11 18:47:35,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, ppid=110, state=SUCCESS; OpenRegionProcedure a4240b09888f2c679a6d53d3ba64e5d8, server=jenkins-hbase9.apache.org,40505,1689101231800 in 168 msec 2023-07-11 18:47:35,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, REOPEN/MOVE in 488 msec 2023-07-11 18:47:35,026 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:35,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=false 2023-07-11 18:47:35,057 DEBUG [hconnection-0x3324104a-shared-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:35,110 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:35,119 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.2.10 first region in multi=testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:35,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.HRegion(8805): writing data to region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 18:47:35,194 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1078): Initial regions: testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:35,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:35,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.client.DoNotRetryRegionException: a4240b09888f2c679a6d53d3ba64e5d8 is not OPEN; state=CLOSING at org.apache.hadoop.hbase.master.assignment.RegionStateNode.checkOnline(RegionStateNode.java:291) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkOnline(AbstractStateMachineTableProcedure.java:193) at org.apache.hadoop.hbase.master.assignment.SplitTableRegionProcedure.(SplitTableRegionProcedure.java:113) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.createSplitProcedure(AssignmentManager.java:963) at org.apache.hadoop.hbase.master.HMaster$3.run(HMaster.java:1984) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.splitRegion(HMaster.java:1977) at org.apache.hadoop.hbase.master.MasterRpcServices.splitRegion(MasterRpcServices.java:866) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-11 18:47:35,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] ipc.CallRunner(144): callId: 35 service: MasterService methodName: SplitRegion size: 111 connection: 172.31.2.10:41582 deadline: 1689101315197, exception=org.apache.hadoop.hbase.client.DoNotRetryRegionException: a4240b09888f2c679a6d53d3ba64e5d8 is not OPEN; state=CLOSING 2023-07-11 18:47:35,270 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:47:36,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:36,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] assignment.SplitTableRegionProcedure(206): testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. splitKey isn't explicitly specified, will try to find a best split key from RS jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:36,203 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HRegion(2745): Flushing a4240b09888f2c679a6d53d3ba64e5d8 1/1 column families, dataSize=583.58 KB heapSize=1.88 MB 2023-07-11 18:47:36,230 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=583.58 KB at sequenceid=8 (bloomFilter=false), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/.tmp/info/1b92f430ddfc472ebc7a0b83637fe044 2023-07-11 18:47:36,237 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/.tmp/info/1b92f430ddfc472ebc7a0b83637fe044 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044 2023-07-11 18:47:36,242 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044, entries=17576, sequenceid=8, filesize=606.0 K 2023-07-11 18:47:36,243 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HRegion(2948): Finished flush of dataSize ~583.58 KB/597584, heapSize ~1.88 MB/1968752, currentSize=0 B/0 for a4240b09888f2c679a6d53d3ba64e5d8 in 40ms, sequenceid=8, compaction requested=false 2023-07-11 18:47:36,243 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testSplitRollbackOnRegionClosing' 2023-07-11 18:47:36,244 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40505] regionserver.HRegion(2446): Flush status journal for a4240b09888f2c679a6d53d3ba64e5d8: 2023-07-11 18:47:36,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:36,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitRollbackOnRegionClosing, parent=a4240b09888f2c679a6d53d3ba64e5d8, daughterA=83fe1258a020c8284afa89fd80ada9be, daughterB=061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,247 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=114, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitRollbackOnRegionClosing, parent=a4240b09888f2c679a6d53d3ba64e5d8, daughterA=83fe1258a020c8284afa89fd80ada9be, daughterB=061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,247 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=114, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitRollbackOnRegionClosing, parent=a4240b09888f2c679a6d53d3ba64e5d8, daughterA=83fe1258a020c8284afa89fd80ada9be, daughterB=061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,247 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=114, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitRollbackOnRegionClosing, parent=a4240b09888f2c679a6d53d3ba64e5d8, daughterA=83fe1258a020c8284afa89fd80ada9be, daughterB=061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 18:47:36,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, UNASSIGN}] 2023-07-11 18:47:36,251 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, UNASSIGN 2023-07-11 18:47:36,252 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a4240b09888f2c679a6d53d3ba64e5d8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:36,252 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101256252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101256252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101256252"}]},"ts":"1689101256252"} 2023-07-11 18:47:36,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=116, ppid=115, state=RUNNABLE; CloseRegionProcedure a4240b09888f2c679a6d53d3ba64e5d8, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:36,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 18:47:36,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:36,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a4240b09888f2c679a6d53d3ba64e5d8, disabling compactions & flushes 2023-07-11 18:47:36,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:36,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:36,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. after waiting 0 ms 2023-07-11 18:47:36,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:36,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=4 2023-07-11 18:47:36,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8. 2023-07-11 18:47:36,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a4240b09888f2c679a6d53d3ba64e5d8: 2023-07-11 18:47:36,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:36,413 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a4240b09888f2c679a6d53d3ba64e5d8, regionState=CLOSED 2023-07-11 18:47:36,413 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101256413"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101256413"}]},"ts":"1689101256413"} 2023-07-11 18:47:36,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=115 2023-07-11 18:47:36,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=115, state=SUCCESS; CloseRegionProcedure a4240b09888f2c679a6d53d3ba64e5d8, server=jenkins-hbase9.apache.org,40505,1689101231800 in 161 msec 2023-07-11 18:47:36,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-11 18:47:36,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=a4240b09888f2c679a6d53d3ba64e5d8, UNASSIGN in 166 msec 2023-07-11 18:47:36,423 INFO [PEWorker-3] assignment.SplitTableRegionProcedure(694): pid=114 splitting 1 storefiles, region=a4240b09888f2c679a6d53d3ba64e5d8, threads=1 2023-07-11 18:47:36,423 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=114 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044 for region: a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:36,456 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=114 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044 for region: a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:36,456 DEBUG [PEWorker-3] assignment.SplitTableRegionProcedure(755): pid=114 split storefiles for region a4240b09888f2c679a6d53d3ba64e5d8 Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:36,483 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=-1 2023-07-11 18:47:36,485 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=-1 2023-07-11 18:47:36,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101256486"},{"qualifier":"splitA","vlen":69,"tag":[],"timestamp":"1689101256486"},{"qualifier":"splitB","vlen":69,"tag":[],"timestamp":"1689101256486"}]},"ts":"1689101256486"} 2023-07-11 18:47:36,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101256486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101256486"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101256486"}]},"ts":"1689101256486"} 2023-07-11 18:47:36,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101256486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101256486"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101256486"}]},"ts":"1689101256486"} 2023-07-11 18:47:36,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=83fe1258a020c8284afa89fd80ada9be, ASSIGN}, {pid=118, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=061de5890a7693cc420bc7361ec15023, ASSIGN}] 2023-07-11 18:47:36,492 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=83fe1258a020c8284afa89fd80ada9be, ASSIGN 2023-07-11 18:47:36,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=061de5890a7693cc420bc7361ec15023, ASSIGN 2023-07-11 18:47:36,493 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=83fe1258a020c8284afa89fd80ada9be, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:36,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=061de5890a7693cc420bc7361ec15023, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:36,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 18:47:36,643 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:36,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=061de5890a7693cc420bc7361ec15023, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:36,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=83fe1258a020c8284afa89fd80ada9be, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:36,645 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101256645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101256645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101256645"}]},"ts":"1689101256645"} 2023-07-11 18:47:36,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101256645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101256645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101256645"}]},"ts":"1689101256645"} 2023-07-11 18:47:36,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=119, ppid=118, state=RUNNABLE; OpenRegionProcedure 061de5890a7693cc420bc7361ec15023, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:36,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 83fe1258a020c8284afa89fd80ada9be, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:36,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:36,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83fe1258a020c8284afa89fd80ada9be, NAME => 'testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.', STARTKEY => '', ENDKEY => 'nwf'} 2023-07-11 18:47:36,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitRollbackOnRegionClosing 83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:36,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:36,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:36,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:36,803 INFO [StoreOpener-83fe1258a020c8284afa89fd80ada9be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:36,804 DEBUG [StoreOpener-83fe1258a020c8284afa89fd80ada9be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info 2023-07-11 18:47:36,804 DEBUG [StoreOpener-83fe1258a020c8284afa89fd80ada9be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info 2023-07-11 18:47:36,804 INFO [StoreOpener-83fe1258a020c8284afa89fd80ada9be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83fe1258a020c8284afa89fd80ada9be columnFamilyName info 2023-07-11 18:47:36,815 DEBUG [StoreOpener-83fe1258a020c8284afa89fd80ada9be-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044-bottom 2023-07-11 18:47:36,816 INFO [StoreOpener-83fe1258a020c8284afa89fd80ada9be-1] regionserver.HStore(310): Store=83fe1258a020c8284afa89fd80ada9be/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:36,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:36,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:36,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:36,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 83fe1258a020c8284afa89fd80ada9be; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72940222, jitterRate=0.08689400553703308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:36,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 83fe1258a020c8284afa89fd80ada9be: 2023-07-11 18:47:36,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be., pid=120, masterSystemTime=1689101256798 2023-07-11 18:47:36,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:36,824 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:36,825 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:36,825 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1912): 83fe1258a020c8284afa89fd80ada9be/info is initiating minor compaction (all files) 2023-07-11 18:47:36,825 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 83fe1258a020c8284afa89fd80ada9be/info in testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:36,825 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044-bottom] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/.tmp, totalSize=606.0 K 2023-07-11 18:47:36,826 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] compactions.Compactor(207): Compacting 1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8, keycount=8788, bloomtype=NONE, size=606.0 K, encoding=NONE, compression=NONE, seqNum=8, earliestPutTs=1689101255146 2023-07-11 18:47:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:36,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:36,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 061de5890a7693cc420bc7361ec15023, NAME => 'testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.', STARTKEY => 'nwf', ENDKEY => ''} 2023-07-11 18:47:36,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=83fe1258a020c8284afa89fd80ada9be, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitRollbackOnRegionClosing 061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101256826"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101256826"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101256826"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101256826"}]},"ts":"1689101256826"} 2023-07-11 18:47:36,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:36,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,828 INFO [StoreOpener-061de5890a7693cc420bc7361ec15023-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,829 DEBUG [StoreOpener-061de5890a7693cc420bc7361ec15023-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info 2023-07-11 18:47:36,829 DEBUG [StoreOpener-061de5890a7693cc420bc7361ec15023-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info 2023-07-11 18:47:36,830 INFO [StoreOpener-061de5890a7693cc420bc7361ec15023-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 061de5890a7693cc420bc7361ec15023 columnFamilyName info 2023-07-11 18:47:36,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-07-11 18:47:36,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 83fe1258a020c8284afa89fd80ada9be, server=jenkins-hbase9.apache.org,40505,1689101231800 in 181 msec 2023-07-11 18:47:36,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=83fe1258a020c8284afa89fd80ada9be, ASSIGN in 341 msec 2023-07-11 18:47:36,837 DEBUG [StoreOpener-061de5890a7693cc420bc7361ec15023-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044-top 2023-07-11 18:47:36,837 INFO [StoreOpener-061de5890a7693cc420bc7361ec15023-1] regionserver.HStore(310): Store=061de5890a7693cc420bc7361ec15023/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:36,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,844 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] throttle.PressureAwareThroughputController(145): 83fe1258a020c8284afa89fd80ada9be#info#compaction#35 average throughput is 23.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:36,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:36,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 061de5890a7693cc420bc7361ec15023; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73086596, jitterRate=0.08907514810562134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:36,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 061de5890a7693cc420bc7361ec15023: 2023-07-11 18:47:36,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023., pid=119, masterSystemTime=1689101256798 2023-07-11 18:47:36,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-07-11 18:47:36,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:36,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:36,848 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=061de5890a7693cc420bc7361ec15023, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:36,848 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101256848"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101256848"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101256848"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101256848"}]},"ts":"1689101256848"} 2023-07-11 18:47:36,850 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-07-11 18:47:36,851 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF info since it belongs to recently split daughter region testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:36,851 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1912): 061de5890a7693cc420bc7361ec15023/info is initiating minor compaction (all files) 2023-07-11 18:47:36,851 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 061de5890a7693cc420bc7361ec15023/info in testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:36,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 18:47:36,852 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044-top] into tmpdir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/.tmp, totalSize=606.0 K 2023-07-11 18:47:36,852 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] compactions.Compactor(207): Compacting 1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8, keycount=8788, bloomtype=NONE, size=606.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1689101255146 2023-07-11 18:47:36,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=118 2023-07-11 18:47:36,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=118, state=SUCCESS; OpenRegionProcedure 061de5890a7693cc420bc7361ec15023, server=jenkins-hbase9.apache.org,40505,1689101231800 in 205 msec 2023-07-11 18:47:36,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=114 2023-07-11 18:47:36,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=061de5890a7693cc420bc7361ec15023, ASSIGN in 365 msec 2023-07-11 18:47:36,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; SplitTableRegionProcedure table=testSplitRollbackOnRegionClosing, parent=a4240b09888f2c679a6d53d3ba64e5d8, daughterA=83fe1258a020c8284afa89fd80ada9be, daughterB=061de5890a7693cc420bc7361ec15023 in 613 msec 2023-07-11 18:47:36,864 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/.tmp/info/88c0a87656904167b14b2df2f6130877 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/88c0a87656904167b14b2df2f6130877 2023-07-11 18:47:36,869 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] throttle.PressureAwareThroughputController(145): 061de5890a7693cc420bc7361ec15023#info#compaction#36 average throughput is 24.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-07-11 18:47:36,871 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 83fe1258a020c8284afa89fd80ada9be/info of 83fe1258a020c8284afa89fd80ada9be into 88c0a87656904167b14b2df2f6130877(size=325.0 K), total size for store is 325.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:36,871 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 83fe1258a020c8284afa89fd80ada9be: 2023-07-11 18:47:36,871 INFO [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be., storeName=83fe1258a020c8284afa89fd80ada9be/info, priority=15, startTime=1689101256823; duration=0sec 2023-07-11 18:47:36,871 DEBUG [RS:2;jenkins-hbase9:40505-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:36,880 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/.tmp/info/a8001c77281946268bba24e3bdea3d67 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/a8001c77281946268bba24e3bdea3d67 2023-07-11 18:47:36,885 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HStore(1652): Completed compaction of 1 (all) file(s) in 061de5890a7693cc420bc7361ec15023/info of 061de5890a7693cc420bc7361ec15023 into a8001c77281946268bba24e3bdea3d67(size=285.6 K), total size for store is 285.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-07-11 18:47:36,885 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 061de5890a7693cc420bc7361ec15023: 2023-07-11 18:47:36,885 INFO [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023., storeName=061de5890a7693cc420bc7361ec15023/info, priority=15, startTime=1689101256846; duration=0sec 2023-07-11 18:47:36,885 DEBUG [RS:2;jenkins-hbase9:40505-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-07-11 18:47:37,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 18:47:37,353 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: SPLIT_REGION, Table Name: default:testSplitRollbackOnRegionClosing, procId: 114 completed 2023-07-11 18:47:37,355 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:37,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=true 2023-07-11 18:47:37,356 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(174): Tear down, remove table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,357 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=121, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=121 2023-07-11 18:47:37,360 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitRollbackOnRegionClosing","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101257360"}]},"ts":"1689101257360"} 2023-07-11 18:47:37,361 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testSplitRollbackOnRegionClosing, state=DISABLING in hbase:meta 2023-07-11 18:47:37,363 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testSplitRollbackOnRegionClosing to state=DISABLING 2023-07-11 18:47:37,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=121, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=83fe1258a020c8284afa89fd80ada9be, UNASSIGN}, {pid=123, ppid=121, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=061de5890a7693cc420bc7361ec15023, UNASSIGN}] 2023-07-11 18:47:37,365 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=122, ppid=121, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=83fe1258a020c8284afa89fd80ada9be, UNASSIGN 2023-07-11 18:47:37,365 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=123, ppid=121, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=061de5890a7693cc420bc7361ec15023, UNASSIGN 2023-07-11 18:47:37,366 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=122 updating hbase:meta row=83fe1258a020c8284afa89fd80ada9be, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:37,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=123 updating hbase:meta row=061de5890a7693cc420bc7361ec15023, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:37,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101257365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101257365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101257365"}]},"ts":"1689101257365"} 2023-07-11 18:47:37,366 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101257366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101257366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101257366"}]},"ts":"1689101257366"} 2023-07-11 18:47:37,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=124, ppid=122, state=RUNNABLE; CloseRegionProcedure 83fe1258a020c8284afa89fd80ada9be, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:37,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=125, ppid=123, state=RUNNABLE; CloseRegionProcedure 061de5890a7693cc420bc7361ec15023, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:37,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=121 2023-07-11 18:47:37,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:37,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 061de5890a7693cc420bc7361ec15023, disabling compactions & flushes 2023-07-11 18:47:37,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:37,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:37,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. after waiting 0 ms 2023-07-11 18:47:37,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:37,519 DEBUG [StoreCloser-testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044-top] to archive 2023-07-11 18:47:37,520 DEBUG [StoreCloser-testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:37,522 DEBUG [StoreCloser-testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:37,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=11 2023-07-11 18:47:37,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023. 2023-07-11 18:47:37,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 061de5890a7693cc420bc7361ec15023: 2023-07-11 18:47:37,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:37,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:37,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 83fe1258a020c8284afa89fd80ada9be, disabling compactions & flushes 2023-07-11 18:47:37,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:37,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:37,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. after waiting 0 ms 2023-07-11 18:47:37,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:37,527 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=123 updating hbase:meta row=061de5890a7693cc420bc7361ec15023, regionState=CLOSED 2023-07-11 18:47:37,528 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101257527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101257527"}]},"ts":"1689101257527"} 2023-07-11 18:47:37,528 DEBUG [StoreCloser-testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044-bottom] to archive 2023-07-11 18:47:37,528 DEBUG [StoreCloser-testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-07-11 18:47:37,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=125, resume processing ppid=123 2023-07-11 18:47:37,530 DEBUG [StoreCloser-testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:37,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=125, ppid=123, state=SUCCESS; CloseRegionProcedure 061de5890a7693cc420bc7361ec15023, server=jenkins-hbase9.apache.org,40505,1689101231800 in 162 msec 2023-07-11 18:47:37,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=123, ppid=121, state=SUCCESS; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=061de5890a7693cc420bc7361ec15023, UNASSIGN in 167 msec 2023-07-11 18:47:37,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=11 2023-07-11 18:47:37,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be. 2023-07-11 18:47:37,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 83fe1258a020c8284afa89fd80ada9be: 2023-07-11 18:47:37,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:37,536 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=122 updating hbase:meta row=83fe1258a020c8284afa89fd80ada9be, regionState=CLOSED 2023-07-11 18:47:37,536 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101257536"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101257536"}]},"ts":"1689101257536"} 2023-07-11 18:47:37,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=124, resume processing ppid=122 2023-07-11 18:47:37,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=124, ppid=122, state=SUCCESS; CloseRegionProcedure 83fe1258a020c8284afa89fd80ada9be, server=jenkins-hbase9.apache.org,40505,1689101231800 in 170 msec 2023-07-11 18:47:37,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=121 2023-07-11 18:47:37,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=121, state=SUCCESS; TransitRegionStateProcedure table=testSplitRollbackOnRegionClosing, region=83fe1258a020c8284afa89fd80ada9be, UNASSIGN in 175 msec 2023-07-11 18:47:37,540 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitRollbackOnRegionClosing","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101257540"}]},"ts":"1689101257540"} 2023-07-11 18:47:37,541 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testSplitRollbackOnRegionClosing, state=DISABLED in hbase:meta 2023-07-11 18:47:37,542 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testSplitRollbackOnRegionClosing to state=DISABLED 2023-07-11 18:47:37,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=121, state=SUCCESS; DisableTableProcedure table=testSplitRollbackOnRegionClosing in 186 msec 2023-07-11 18:47:37,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=121 2023-07-11 18:47:37,662 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testSplitRollbackOnRegionClosing, procId: 121 completed 2023-07-11 18:47:37,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=126, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,665 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=126, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,666 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=126, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=126 2023-07-11 18:47:37,670 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:37,671 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:37,671 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:37,672 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits] 2023-07-11 18:47:37,673 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits] 2023-07-11 18:47:37,673 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits] 2023-07-11 18:47:37,676 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/a8001c77281946268bba24e3bdea3d67 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/a8001c77281946268bba24e3bdea3d67 2023-07-11 18:47:37,676 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/88c0a87656904167b14b2df2f6130877 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/88c0a87656904167b14b2df2f6130877 2023-07-11 18:47:37,677 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044 2023-07-11 18:47:37,680 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits/15.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits/15.seqid 2023-07-11 18:47:37,680 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits/15.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits/15.seqid 2023-07-11 18:47:37,680 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023 2023-07-11 18:47:37,680 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits/11.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits/11.seqid 2023-07-11 18:47:37,680 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be 2023-07-11 18:47:37,681 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 2023-07-11 18:47:37,681 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testSplitRollbackOnRegionClosing regions 2023-07-11 18:47:37,683 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=126, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,685 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testSplitRollbackOnRegionClosing from hbase:meta 2023-07-11 18:47:37,687 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testSplitRollbackOnRegionClosing' descriptor. 2023-07-11 18:47:37,687 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=126, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,688 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testSplitRollbackOnRegionClosing' from region states. 2023-07-11 18:47:37,688 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101257688"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:37,688 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101257688"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:37,688 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101257688"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:37,689 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-11 18:47:37,689 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a4240b09888f2c679a6d53d3ba64e5d8, NAME => 'testSplitRollbackOnRegionClosing,,1689101253899.a4240b09888f2c679a6d53d3ba64e5d8.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 83fe1258a020c8284afa89fd80ada9be, NAME => 'testSplitRollbackOnRegionClosing,,1689101256244.83fe1258a020c8284afa89fd80ada9be.', STARTKEY => '', ENDKEY => 'nwf'}, {ENCODED => 061de5890a7693cc420bc7361ec15023, NAME => 'testSplitRollbackOnRegionClosing,nwf,1689101256244.061de5890a7693cc420bc7361ec15023.', STARTKEY => 'nwf', ENDKEY => ''}] 2023-07-11 18:47:37,689 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testSplitRollbackOnRegionClosing' as deleted. 2023-07-11 18:47:37,689 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitRollbackOnRegionClosing","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101257689"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:37,690 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testSplitRollbackOnRegionClosing state from META 2023-07-11 18:47:37,694 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=126, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testSplitRollbackOnRegionClosing 2023-07-11 18:47:37,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=126, state=SUCCESS; DeleteTableProcedure table=testSplitRollbackOnRegionClosing in 31 msec 2023-07-11 18:47:37,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=126 2023-07-11 18:47:37,767 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testSplitRollbackOnRegionClosing, procId: 126 completed 2023-07-11 18:47:37,783 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testSplitRollbackOnRegionClosing Thread=431 (was 433), OpenFileDescriptor=816 (was 820), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=242 (was 263), ProcessCount=170 (was 170), AvailableMemoryMB=7676 (was 7746) 2023-07-11 18:47:37,797 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testContinuousSplitUsingLinkFile Thread=431, OpenFileDescriptor=816, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=170, AvailableMemoryMB=7675 2023-07-11 18:47:37,798 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:37,798 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:37,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testContinuousSplitUsingLinkFile', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:37,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=127, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:37,802 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=127, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testContinuousSplitUsingLinkFile execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:37,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testContinuousSplitUsingLinkFile" procId is: 127 2023-07-11 18:47:37,803 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=127, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testContinuousSplitUsingLinkFile execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:37,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=127 2023-07-11 18:47:37,804 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:37,805 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 empty. 2023-07-11 18:47:37,805 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:37,805 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testContinuousSplitUsingLinkFile regions 2023-07-11 18:47:37,815 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:37,816 INFO [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(7675): creating {ENCODED => ccfdcfcce076ae8d4eba487c11557fc3, NAME => 'testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testContinuousSplitUsingLinkFile', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:37,824 DEBUG [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(866): Instantiated testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:37,824 DEBUG [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(1604): Closing ccfdcfcce076ae8d4eba487c11557fc3, disabling compactions & flushes 2023-07-11 18:47:37,824 INFO [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(1626): Closing region testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:37,824 DEBUG [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:37,824 DEBUG [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(1714): Acquired close lock on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. after waiting 0 ms 2023-07-11 18:47:37,824 DEBUG [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(1724): Updates disabled for region testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:37,825 INFO [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(1838): Closed testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:37,825 DEBUG [RegionOpenAndInit-testContinuousSplitUsingLinkFile-pool-0] regionserver.HRegion(1558): Region close journal for ccfdcfcce076ae8d4eba487c11557fc3: 2023-07-11 18:47:37,827 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=127, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testContinuousSplitUsingLinkFile execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:37,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101257827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101257827"}]},"ts":"1689101257827"} 2023-07-11 18:47:37,829 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:37,829 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=127, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testContinuousSplitUsingLinkFile execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:37,830 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101257829"}]},"ts":"1689101257829"} 2023-07-11 18:47:37,831 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testContinuousSplitUsingLinkFile, state=ENABLING in hbase:meta 2023-07-11 18:47:37,833 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:37,834 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:37,834 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:37,834 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:37,834 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:37,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=128, ppid=127, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=ccfdcfcce076ae8d4eba487c11557fc3, ASSIGN}] 2023-07-11 18:47:37,836 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=128, ppid=127, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=ccfdcfcce076ae8d4eba487c11557fc3, ASSIGN 2023-07-11 18:47:37,836 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=128, ppid=127, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=ccfdcfcce076ae8d4eba487c11557fc3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:37,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=127 2023-07-11 18:47:37,987 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:37,988 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=128 updating hbase:meta row=ccfdcfcce076ae8d4eba487c11557fc3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:37,988 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101257988"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101257988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101257988"}]},"ts":"1689101257988"} 2023-07-11 18:47:37,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=129, ppid=128, state=RUNNABLE; OpenRegionProcedure ccfdcfcce076ae8d4eba487c11557fc3, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:38,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=127 2023-07-11 18:47:38,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ccfdcfcce076ae8d4eba487c11557fc3, NAME => 'testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:38,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testContinuousSplitUsingLinkFile ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:38,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:38,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:38,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:38,146 INFO [StoreOpener-ccfdcfcce076ae8d4eba487c11557fc3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:38,147 DEBUG [StoreOpener-ccfdcfcce076ae8d4eba487c11557fc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf 2023-07-11 18:47:38,147 DEBUG [StoreOpener-ccfdcfcce076ae8d4eba487c11557fc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf 2023-07-11 18:47:38,147 INFO [StoreOpener-ccfdcfcce076ae8d4eba487c11557fc3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ccfdcfcce076ae8d4eba487c11557fc3 columnFamilyName cf 2023-07-11 18:47:38,148 INFO [StoreOpener-ccfdcfcce076ae8d4eba487c11557fc3-1] regionserver.HStore(310): Store=ccfdcfcce076ae8d4eba487c11557fc3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:38,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:38,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:38,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:38,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:38,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ccfdcfcce076ae8d4eba487c11557fc3; next sequenceid=2; ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73696532, jitterRate=0.098163902759552}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:38,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ccfdcfcce076ae8d4eba487c11557fc3: 2023-07-11 18:47:38,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3., pid=129, masterSystemTime=1689101258141 2023-07-11 18:47:38,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,156 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=128 updating hbase:meta row=ccfdcfcce076ae8d4eba487c11557fc3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101258156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101258156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101258156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101258156"}]},"ts":"1689101258156"} 2023-07-11 18:47:38,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=129, resume processing ppid=128 2023-07-11 18:47:38,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=129, ppid=128, state=SUCCESS; OpenRegionProcedure ccfdcfcce076ae8d4eba487c11557fc3, server=jenkins-hbase9.apache.org,34803,1689101231723 in 167 msec 2023-07-11 18:47:38,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=128, resume processing ppid=127 2023-07-11 18:47:38,160 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=128, ppid=127, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=ccfdcfcce076ae8d4eba487c11557fc3, ASSIGN in 325 msec 2023-07-11 18:47:38,160 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=127, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testContinuousSplitUsingLinkFile execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:38,161 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101258160"}]},"ts":"1689101258160"} 2023-07-11 18:47:38,161 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testContinuousSplitUsingLinkFile, state=ENABLED in hbase:meta 2023-07-11 18:47:38,163 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=127, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testContinuousSplitUsingLinkFile execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:38,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=127, state=SUCCESS; CreateTableProcedure table=testContinuousSplitUsingLinkFile in 363 msec 2023-07-11 18:47:38,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=127 2023-07-11 18:47:38,407 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testContinuousSplitUsingLinkFile, procId: 127 completed 2023-07-11 18:47:38,439 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:38,441 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:47:38,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33849] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 18:47:38,443 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:38,444 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40036, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:47:38,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34803] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 18:47:38,445 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 18:47:38,446 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 18:47:38,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 18:47:38,447 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:38,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:38,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(165): Submitting procedure testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,458 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testContinuousSplitUsingLinkFile' 2023-07-11 18:47:38,458 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,458 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testContinuousSplitUsingLinkFile' starting 'acquire' 2023-07-11 18:47:38,458 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testContinuousSplitUsingLinkFile', kicking off acquire phase on members. 2023-07-11 18:47:38,458 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,458 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,460 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,460 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,460 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,460 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,461 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,461 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:38,462 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,463 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. started... 2023-07-11 18:47:38,463 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,463 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:38,463 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ccfdcfcce076ae8d4eba487c11557fc3 1/1 column families, dataSize=120 B heapSize=672 B 2023-07-11 18:47:38,462 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,464 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,464 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,465 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,465 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,465 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,466 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,466 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,466 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,474 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=120 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.tmp/cf/97dcdea10c3e468e9cdf494c164cb57b 2023-07-11 18:47:38,479 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.tmp/cf/97dcdea10c3e468e9cdf494c164cb57b as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b 2023-07-11 18:47:38,483 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b, entries=4, sequenceid=8, filesize=4.9 K 2023-07-11 18:47:38,484 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~120 B/120, heapSize ~656 B/656, currentSize=0 B/0 for ccfdcfcce076ae8d4eba487c11557fc3 in 21ms, sequenceid=8, compaction requested=false 2023-07-11 18:47:38,484 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testContinuousSplitUsingLinkFile' 2023-07-11 18:47:38,484 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ccfdcfcce076ae8d4eba487c11557fc3: 2023-07-11 18:47:38,484 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,484 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:38,484 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:38,484 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,484 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,484 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,486 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,486 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,486 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,486 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure 'testContinuousSplitUsingLinkFile' on coordinator 2023-07-11 18:47:38,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a0e33bf[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:38,488 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testContinuousSplitUsingLinkFile' starting 'in-barrier' execution. 2023-07-11 18:47:38,488 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,490 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,490 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,490 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:38,491 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,491 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,491 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:38,492 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,492 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,492 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,492 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,493 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,493 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,493 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,494 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,494 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,494 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testContinuousSplitUsingLinkFile' member 'jenkins-hbase9.apache.org,34803,1689101231723': 2023-07-11 18:47:38,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' released barrier for procedure'testContinuousSplitUsingLinkFile', counting down latch. Waiting for 0 more 2023-07-11 18:47:38,496 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testContinuousSplitUsingLinkFile' execution completed 2023-07-11 18:47:38,496 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:38,496 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:38,496 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,496 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testContinuousSplitUsingLinkFileincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:38,499 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,499 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,499 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,499 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,499 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,500 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,500 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,502 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,502 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,502 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,508 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testContinuousSplitUsingLinkFile' 2023-07-11 18:47:38,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,509 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,508 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testContinuousSplitUsingLinkFile'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:38,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,509 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,509 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:38,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,509 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,509 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,509 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,609 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:38,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:38,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:38,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(143): Procedure testContinuousSplitUsingLinkFile was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:38,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(165): Submitting procedure testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,618 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testContinuousSplitUsingLinkFile' 2023-07-11 18:47:38,619 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,619 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testContinuousSplitUsingLinkFile' starting 'acquire' 2023-07-11 18:47:38,619 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testContinuousSplitUsingLinkFile', kicking off acquire phase on members. 2023-07-11 18:47:38,619 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,619 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,620 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,620 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,620 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,620 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,621 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,621 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testContinuousSplitUsingLinkFile is still present, removing 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testContinuousSplitUsingLinkFile is still present, removing 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,622 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testContinuousSplitUsingLinkFile is still present, removing 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:38,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,622 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,622 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. started... 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,622 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,622 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ccfdcfcce076ae8d4eba487c11557fc3 1/1 column families, dataSize=120 B heapSize=672 B 2023-07-11 18:47:38,623 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,623 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,623 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,623 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,625 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,626 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,626 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,626 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,626 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,626 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,632 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=120 B at sequenceid=15 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.tmp/cf/4a0b2d1dba3d4a34abcc61a773d34aaa 2023-07-11 18:47:38,636 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.tmp/cf/4a0b2d1dba3d4a34abcc61a773d34aaa as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa 2023-07-11 18:47:38,641 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa, entries=4, sequenceid=15, filesize=4.9 K 2023-07-11 18:47:38,641 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~120 B/120, heapSize ~656 B/656, currentSize=0 B/0 for ccfdcfcce076ae8d4eba487c11557fc3 in 19ms, sequenceid=15, compaction requested=false 2023-07-11 18:47:38,641 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ccfdcfcce076ae8d4eba487c11557fc3: 2023-07-11 18:47:38,641 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,641 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:38,642 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:38,642 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,642 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,642 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,643 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,643 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,643 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,643 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure 'testContinuousSplitUsingLinkFile' on coordinator 2023-07-11 18:47:38,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c9d28e[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:38,645 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testContinuousSplitUsingLinkFile' starting 'in-barrier' execution. 2023-07-11 18:47:38,645 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,646 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,646 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,647 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:38,647 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,647 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:38,647 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:38,649 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,650 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,650 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,650 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,650 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,650 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,650 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,651 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,651 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,651 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testContinuousSplitUsingLinkFile' member 'jenkins-hbase9.apache.org,34803,1689101231723': 2023-07-11 18:47:38,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' released barrier for procedure'testContinuousSplitUsingLinkFile', counting down latch. Waiting for 0 more 2023-07-11 18:47:38,653 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testContinuousSplitUsingLinkFile' execution completed 2023-07-11 18:47:38,654 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:38,654 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:38,654 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,654 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testContinuousSplitUsingLinkFileincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:38,655 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,655 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,655 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,655 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,656 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,656 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,656 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,658 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,658 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,658 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,661 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,661 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,661 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testContinuousSplitUsingLinkFile' 2023-07-11 18:47:38,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:38,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,662 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testContinuousSplitUsingLinkFile'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:38,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:38,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,662 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,663 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,663 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,663 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,763 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:38,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:38,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:38,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(143): Procedure testContinuousSplitUsingLinkFile was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:38,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(165): Submitting procedure testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,772 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testContinuousSplitUsingLinkFile' 2023-07-11 18:47:38,772 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,772 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testContinuousSplitUsingLinkFile' starting 'acquire' 2023-07-11 18:47:38,772 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testContinuousSplitUsingLinkFile', kicking off acquire phase on members. 2023-07-11 18:47:38,772 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,772 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,773 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,773 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,773 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,773 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,774 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,774 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:38,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,775 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testContinuousSplitUsingLinkFile is still present, removing 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,776 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testContinuousSplitUsingLinkFile is still present, removing 2023-07-11 18:47:38,776 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testContinuousSplitUsingLinkFile is still present, removing 2023-07-11 18:47:38,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testContinuousSplitUsingLinkFile' with timeout 60000ms 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testContinuousSplitUsingLinkFile' starting 'acquire' stage 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:38,776 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:38,776 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,776 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. started... 2023-07-11 18:47:38,777 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ccfdcfcce076ae8d4eba487c11557fc3 1/1 column families, dataSize=120 B heapSize=672 B 2023-07-11 18:47:38,777 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,778 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,778 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,778 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,778 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,778 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,786 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=120 B at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.tmp/cf/51adb46ba2224c2980adab43d6be3499 2023-07-11 18:47:38,791 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.tmp/cf/51adb46ba2224c2980adab43d6be3499 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499 2023-07-11 18:47:38,796 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499, entries=4, sequenceid=22, filesize=4.9 K 2023-07-11 18:47:38,797 INFO [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~120 B/120, heapSize ~656 B/656, currentSize=0 B/0 for ccfdcfcce076ae8d4eba487c11557fc3 in 21ms, sequenceid=22, compaction requested=true 2023-07-11 18:47:38,797 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ccfdcfcce076ae8d4eba487c11557fc3: 2023-07-11 18:47:38,797 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,797 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:38,797 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:38,797 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,797 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testContinuousSplitUsingLinkFile' locally acquired 2023-07-11 18:47:38,797 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testContinuousSplitUsingLinkFile) in zk 2023-07-11 18:47:38,800 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,800 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,800 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,800 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testContinuousSplitUsingLinkFile' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure 'testContinuousSplitUsingLinkFile' on coordinator 2023-07-11 18:47:38,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70f658cf[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:38,802 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testContinuousSplitUsingLinkFile' starting 'in-barrier' execution. 2023-07-11 18:47:38,802 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,803 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,803 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,804 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,804 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,804 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:38,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testContinuousSplitUsingLinkFile' received 'reached' from coordinator. 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testContinuousSplitUsingLinkFile' locally completed 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:38,804 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testContinuousSplitUsingLinkFile' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:38,806 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,806 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,806 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,810 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,810 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,810 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testContinuousSplitUsingLinkFile' has notified controller of completion 2023-07-11 18:47:38,810 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,810 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,810 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,810 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testContinuousSplitUsingLinkFile' completed. 2023-07-11 18:47:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testContinuousSplitUsingLinkFile' member 'jenkins-hbase9.apache.org,34803,1689101231723': 2023-07-11 18:47:38,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' released barrier for procedure'testContinuousSplitUsingLinkFile', counting down latch. Waiting for 0 more 2023-07-11 18:47:38,813 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testContinuousSplitUsingLinkFile' execution completed 2023-07-11 18:47:38,813 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:38,813 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:38,813 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,813 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testContinuousSplitUsingLinkFileincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:38,815 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:38,815 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,815 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:38,816 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,816 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,818 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:38,818 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,818 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:38,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testContinuousSplitUsingLinkFile' 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:38,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,821 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:38,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:38,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testContinuousSplitUsingLinkFile'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:38,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,821 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testContinuousSplitUsingLinkFile 2023-07-11 18:47:38,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:38,922 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:38,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:38,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:38,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=130, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=ccfdcfcce076ae8d4eba487c11557fc3, daughterA=44c007c6ef70de48c276f075634e0784, daughterB=49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:38,936 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=130, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=ccfdcfcce076ae8d4eba487c11557fc3, daughterA=44c007c6ef70de48c276f075634e0784, daughterB=49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:38,936 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=130, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=ccfdcfcce076ae8d4eba487c11557fc3, daughterA=44c007c6ef70de48c276f075634e0784, daughterB=49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:38,936 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=130, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=ccfdcfcce076ae8d4eba487c11557fc3, daughterA=44c007c6ef70de48c276f075634e0784, daughterB=49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:38,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=131, ppid=130, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=ccfdcfcce076ae8d4eba487c11557fc3, UNASSIGN}] 2023-07-11 18:47:38,939 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=131, ppid=130, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=ccfdcfcce076ae8d4eba487c11557fc3, UNASSIGN 2023-07-11 18:47:38,939 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=131 updating hbase:meta row=ccfdcfcce076ae8d4eba487c11557fc3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:38,939 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101258939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101258939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101258939"}]},"ts":"1689101258939"} 2023-07-11 18:47:38,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=132, ppid=131, state=RUNNABLE; CloseRegionProcedure ccfdcfcce076ae8d4eba487c11557fc3, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:39,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ccfdcfcce076ae8d4eba487c11557fc3, disabling compactions & flushes 2023-07-11 18:47:39,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:39,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:39,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. after waiting 0 ms 2023-07-11 18:47:39,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:39,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-07-11 18:47:39,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. 2023-07-11 18:47:39,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ccfdcfcce076ae8d4eba487c11557fc3: 2023-07-11 18:47:39,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,099 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=131 updating hbase:meta row=ccfdcfcce076ae8d4eba487c11557fc3, regionState=CLOSED 2023-07-11 18:47:39,099 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101259099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101259099"}]},"ts":"1689101259099"} 2023-07-11 18:47:39,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=132, resume processing ppid=131 2023-07-11 18:47:39,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=132, ppid=131, state=SUCCESS; CloseRegionProcedure ccfdcfcce076ae8d4eba487c11557fc3, server=jenkins-hbase9.apache.org,34803,1689101231723 in 160 msec 2023-07-11 18:47:39,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=131, resume processing ppid=130 2023-07-11 18:47:39,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=131, ppid=130, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=ccfdcfcce076ae8d4eba487c11557fc3, UNASSIGN in 164 msec 2023-07-11 18:47:39,110 INFO [PEWorker-3] assignment.SplitTableRegionProcedure(694): pid=130 splitting 3 storefiles, region=ccfdcfcce076ae8d4eba487c11557fc3, threads=3 2023-07-11 18:47:39,110 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=130 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa for region: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,110 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=130 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499 for region: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,110 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(776): pid=130 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b for region: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,114 DEBUG [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(713): Will create HFileLink file for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b, top=false 2023-07-11 18:47:39,118 DEBUG [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa, top=true 2023-07-11 18:47:39,118 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499, top=true 2023-07-11 18:47:39,120 INFO [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.splits/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b for child: 44c007c6ef70de48c276f075634e0784, parent: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,123 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.splits/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 for child: 49eb6a8a2a32c73db4ac8361350664cb, parent: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,123 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=130 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499 for region: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,123 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(787): pid=130 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b for region: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,123 INFO [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/.splits/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa for child: 49eb6a8a2a32c73db4ac8361350664cb, parent: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,124 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=130 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa for region: ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:39,124 DEBUG [PEWorker-3] assignment.SplitTableRegionProcedure(755): pid=130 split storefiles for region ccfdcfcce076ae8d4eba487c11557fc3 Daughter A: 1 storefiles, Daughter B: 2 storefiles. 2023-07-11 18:47:39,147 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=-1 2023-07-11 18:47:39,148 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=-1 2023-07-11 18:47:39,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101259150"},{"qualifier":"splitA","vlen":71,"tag":[],"timestamp":"1689101259150"},{"qualifier":"splitB","vlen":71,"tag":[],"timestamp":"1689101259150"}]},"ts":"1689101259150"} 2023-07-11 18:47:39,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101259150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101259150"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101259150"}]},"ts":"1689101259150"} 2023-07-11 18:47:39,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101259150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101259150"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101259150"}]},"ts":"1689101259150"} 2023-07-11 18:47:39,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=133, ppid=130, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=44c007c6ef70de48c276f075634e0784, ASSIGN}, {pid=134, ppid=130, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=49eb6a8a2a32c73db4ac8361350664cb, ASSIGN}] 2023-07-11 18:47:39,153 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=134, ppid=130, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=49eb6a8a2a32c73db4ac8361350664cb, ASSIGN 2023-07-11 18:47:39,153 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=133, ppid=130, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=44c007c6ef70de48c276f075634e0784, ASSIGN 2023-07-11 18:47:39,154 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=134, ppid=130, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=49eb6a8a2a32c73db4ac8361350664cb, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:39,154 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=133, ppid=130, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=44c007c6ef70de48c276f075634e0784, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:39,304 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:39,306 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=134 updating hbase:meta row=49eb6a8a2a32c73db4ac8361350664cb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:39,306 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=133 updating hbase:meta row=44c007c6ef70de48c276f075634e0784, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:39,306 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101259306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101259306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101259306"}]},"ts":"1689101259306"} 2023-07-11 18:47:39,307 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101259306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101259306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101259306"}]},"ts":"1689101259306"} 2023-07-11 18:47:39,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=135, ppid=134, state=RUNNABLE; OpenRegionProcedure 49eb6a8a2a32c73db4ac8361350664cb, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:39,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=136, ppid=133, state=RUNNABLE; OpenRegionProcedure 44c007c6ef70de48c276f075634e0784, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:39,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. 2023-07-11 18:47:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 49eb6a8a2a32c73db4ac8361350664cb, NAME => 'testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.', STARTKEY => 'row14', ENDKEY => ''} 2023-07-11 18:47:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testContinuousSplitUsingLinkFile 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:39,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:39,464 INFO [StoreOpener-49eb6a8a2a32c73db4ac8361350664cb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:39,465 DEBUG [StoreOpener-49eb6a8a2a32c73db4ac8361350664cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf 2023-07-11 18:47:39,465 DEBUG [StoreOpener-49eb6a8a2a32c73db4ac8361350664cb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf 2023-07-11 18:47:39,466 INFO [StoreOpener-49eb6a8a2a32c73db4ac8361350664cb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49eb6a8a2a32c73db4ac8361350664cb columnFamilyName cf 2023-07-11 18:47:39,473 DEBUG [StoreOpener-49eb6a8a2a32c73db4ac8361350664cb-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa 2023-07-11 18:47:39,477 DEBUG [StoreOpener-49eb6a8a2a32c73db4ac8361350664cb-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 2023-07-11 18:47:39,477 INFO [StoreOpener-49eb6a8a2a32c73db4ac8361350664cb-1] regionserver.HStore(310): Store=49eb6a8a2a32c73db4ac8361350664cb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:39,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:39,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:39,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:39,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 49eb6a8a2a32c73db4ac8361350664cb; next sequenceid=26; ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68152169, jitterRate=0.015546455979347229}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:39,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 49eb6a8a2a32c73db4ac8361350664cb: 2023-07-11 18:47:39,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb., pid=135, masterSystemTime=1689101259460 2023-07-11 18:47:39,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. 2023-07-11 18:47:39,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. 2023-07-11 18:47:39,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. 2023-07-11 18:47:39,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44c007c6ef70de48c276f075634e0784, NAME => 'testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.', STARTKEY => '', ENDKEY => 'row14'} 2023-07-11 18:47:39,485 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=134 updating hbase:meta row=49eb6a8a2a32c73db4ac8361350664cb, regionState=OPEN, openSeqNum=26, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:39,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testContinuousSplitUsingLinkFile 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:39,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:39,485 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101259485"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101259485"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101259485"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101259485"}]},"ts":"1689101259485"} 2023-07-11 18:47:39,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:39,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:39,486 INFO [StoreOpener-44c007c6ef70de48c276f075634e0784-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:39,487 DEBUG [StoreOpener-44c007c6ef70de48c276f075634e0784-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf 2023-07-11 18:47:39,487 DEBUG [StoreOpener-44c007c6ef70de48c276f075634e0784-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf 2023-07-11 18:47:39,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=135, resume processing ppid=134 2023-07-11 18:47:39,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=135, ppid=134, state=SUCCESS; OpenRegionProcedure 49eb6a8a2a32c73db4ac8361350664cb, server=jenkins-hbase9.apache.org,34803,1689101231723 in 178 msec 2023-07-11 18:47:39,488 INFO [StoreOpener-44c007c6ef70de48c276f075634e0784-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44c007c6ef70de48c276f075634e0784 columnFamilyName cf 2023-07-11 18:47:39,488 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=134, ppid=130, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=49eb6a8a2a32c73db4ac8361350664cb, ASSIGN in 335 msec 2023-07-11 18:47:39,493 DEBUG [StoreOpener-44c007c6ef70de48c276f075634e0784-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b 2023-07-11 18:47:39,493 INFO [StoreOpener-44c007c6ef70de48c276f075634e0784-1] regionserver.HStore(310): Store=44c007c6ef70de48c276f075634e0784/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:39,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:39,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:39,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:39,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 44c007c6ef70de48c276f075634e0784; next sequenceid=26; ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66163348, jitterRate=-0.01408928632736206}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:39,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 44c007c6ef70de48c276f075634e0784: 2023-07-11 18:47:39,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784., pid=136, masterSystemTime=1689101259460 2023-07-11 18:47:39,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. 2023-07-11 18:47:39,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. 2023-07-11 18:47:39,500 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=133 updating hbase:meta row=44c007c6ef70de48c276f075634e0784, regionState=OPEN, openSeqNum=26, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:39,500 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101259500"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101259500"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101259500"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101259500"}]},"ts":"1689101259500"} 2023-07-11 18:47:39,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=136, resume processing ppid=133 2023-07-11 18:47:39,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=136, ppid=133, state=SUCCESS; OpenRegionProcedure 44c007c6ef70de48c276f075634e0784, server=jenkins-hbase9.apache.org,34803,1689101231723 in 193 msec 2023-07-11 18:47:39,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=133, resume processing ppid=130 2023-07-11 18:47:39,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=133, ppid=130, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=44c007c6ef70de48c276f075634e0784, ASSIGN in 350 msec 2023-07-11 18:47:39,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=130, state=SUCCESS; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=ccfdcfcce076ae8d4eba487c11557fc3, daughterA=44c007c6ef70de48c276f075634e0784, daughterB=49eb6a8a2a32c73db4ac8361350664cb in 569 msec 2023-07-11 18:47:40,186 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:47:41,937 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [3,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:41,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34803] ipc.CallRunner(144): callId: 120 service: ClientService methodName: Scan size: 155 connection: 172.31.2.10:40030 deadline: 1689101321938, exception=org.apache.hadoop.hbase.NotServingRegionException: testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3. is not online on jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:42,045 DEBUG [Listener at localhost/44535] client.ClientScanner(240): Advancing internal scanner to startKey at 'row14', inclusive 2023-07-11 18:47:42,048 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(441): startKey=, getEndKey()=row14, row=row24 2023-07-11 18:47:42,048 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(441): startKey=row14, getEndKey()=, row=row24 2023-07-11 18:47:42,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. 2023-07-11 18:47:42,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:42,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=137, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=49eb6a8a2a32c73db4ac8361350664cb, daughterA=bc9b2c67e807ae977718306095e413a2, daughterB=8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,053 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=137, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=49eb6a8a2a32c73db4ac8361350664cb, daughterA=bc9b2c67e807ae977718306095e413a2, daughterB=8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,053 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=137, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=49eb6a8a2a32c73db4ac8361350664cb, daughterA=bc9b2c67e807ae977718306095e413a2, daughterB=8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,053 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=137, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=49eb6a8a2a32c73db4ac8361350664cb, daughterA=bc9b2c67e807ae977718306095e413a2, daughterB=8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=138, ppid=137, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=49eb6a8a2a32c73db4ac8361350664cb, UNASSIGN}] 2023-07-11 18:47:42,056 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=138, ppid=137, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=49eb6a8a2a32c73db4ac8361350664cb, UNASSIGN 2023-07-11 18:47:42,056 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=138 updating hbase:meta row=49eb6a8a2a32c73db4ac8361350664cb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:42,056 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101262056"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101262056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101262056"}]},"ts":"1689101262056"} 2023-07-11 18:47:42,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=139, ppid=138, state=RUNNABLE; CloseRegionProcedure 49eb6a8a2a32c73db4ac8361350664cb, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:42,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:42,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 49eb6a8a2a32c73db4ac8361350664cb, disabling compactions & flushes 2023-07-11 18:47:42,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. 2023-07-11 18:47:42,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. 2023-07-11 18:47:42,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. after waiting 0 ms 2023-07-11 18:47:42,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. 2023-07-11 18:47:42,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=25 2023-07-11 18:47:42,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. 2023-07-11 18:47:42,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 49eb6a8a2a32c73db4ac8361350664cb: 2023-07-11 18:47:42,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:42,217 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=138 updating hbase:meta row=49eb6a8a2a32c73db4ac8361350664cb, regionState=CLOSED 2023-07-11 18:47:42,217 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101262217"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101262217"}]},"ts":"1689101262217"} 2023-07-11 18:47:42,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=139, resume processing ppid=138 2023-07-11 18:47:42,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=139, ppid=138, state=SUCCESS; CloseRegionProcedure 49eb6a8a2a32c73db4ac8361350664cb, server=jenkins-hbase9.apache.org,34803,1689101231723 in 161 msec 2023-07-11 18:47:42,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=138, resume processing ppid=137 2023-07-11 18:47:42,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=138, ppid=137, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=49eb6a8a2a32c73db4ac8361350664cb, UNASSIGN in 166 msec 2023-07-11 18:47:42,228 INFO [PEWorker-5] assignment.SplitTableRegionProcedure(694): pid=137 splitting 2 storefiles, region=49eb6a8a2a32c73db4ac8361350664cb, threads=2 2023-07-11 18:47:42,228 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=137 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa for region: 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:42,228 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=137 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 for region: 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:42,232 DEBUG [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(713): Will create HFileLink file for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa, top=false 2023-07-11 18:47:42,236 DEBUG [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499, top=true 2023-07-11 18:47:42,237 INFO [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/.splits/bc9b2c67e807ae977718306095e413a2/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa for child: bc9b2c67e807ae977718306095e413a2, parent: 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:42,240 INFO [StoreFileSplitter-pool-1] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/.splits/8052e7190810ff48a9fad1b880559c95/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 for child: 8052e7190810ff48a9fad1b880559c95, parent: 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:42,240 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=137 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 for region: 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:42,240 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=137 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa for region: 49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:42,240 DEBUG [PEWorker-5] assignment.SplitTableRegionProcedure(755): pid=137 split storefiles for region 49eb6a8a2a32c73db4ac8361350664cb Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:42,266 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=-1 2023-07-11 18:47:42,268 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=-1 2023-07-11 18:47:42,270 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101262269"},{"qualifier":"splitA","vlen":76,"tag":[],"timestamp":"1689101262269"},{"qualifier":"splitB","vlen":71,"tag":[],"timestamp":"1689101262269"}]},"ts":"1689101262269"} 2023-07-11 18:47:42,270 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101262269"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101262269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101262269"}]},"ts":"1689101262269"} 2023-07-11 18:47:42,270 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101262269"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101262269"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101262269"}]},"ts":"1689101262269"} 2023-07-11 18:47:42,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=140, ppid=137, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=bc9b2c67e807ae977718306095e413a2, ASSIGN}, {pid=141, ppid=137, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=8052e7190810ff48a9fad1b880559c95, ASSIGN}] 2023-07-11 18:47:42,273 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=140, ppid=137, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=bc9b2c67e807ae977718306095e413a2, ASSIGN 2023-07-11 18:47:42,273 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=141, ppid=137, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=8052e7190810ff48a9fad1b880559c95, ASSIGN 2023-07-11 18:47:42,274 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=140, ppid=137, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=bc9b2c67e807ae977718306095e413a2, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:42,274 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=141, ppid=137, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=8052e7190810ff48a9fad1b880559c95, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:42,424 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:42,426 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=141 updating hbase:meta row=8052e7190810ff48a9fad1b880559c95, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:42,426 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=140 updating hbase:meta row=bc9b2c67e807ae977718306095e413a2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:42,426 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101262426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101262426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101262426"}]},"ts":"1689101262426"} 2023-07-11 18:47:42,426 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101262426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101262426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101262426"}]},"ts":"1689101262426"} 2023-07-11 18:47:42,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=142, ppid=141, state=RUNNABLE; OpenRegionProcedure 8052e7190810ff48a9fad1b880559c95, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:42,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=143, ppid=140, state=RUNNABLE; OpenRegionProcedure bc9b2c67e807ae977718306095e413a2, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:42,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95. 2023-07-11 18:47:42,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8052e7190810ff48a9fad1b880559c95, NAME => 'testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.', STARTKEY => 'row24', ENDKEY => ''} 2023-07-11 18:47:42,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testContinuousSplitUsingLinkFile 8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:42,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,583 INFO [StoreOpener-8052e7190810ff48a9fad1b880559c95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,584 DEBUG [StoreOpener-8052e7190810ff48a9fad1b880559c95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf 2023-07-11 18:47:42,584 DEBUG [StoreOpener-8052e7190810ff48a9fad1b880559c95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf 2023-07-11 18:47:42,585 INFO [StoreOpener-8052e7190810ff48a9fad1b880559c95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8052e7190810ff48a9fad1b880559c95 columnFamilyName cf 2023-07-11 18:47:42,590 DEBUG [StoreOpener-8052e7190810ff48a9fad1b880559c95-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 2023-07-11 18:47:42,590 INFO [StoreOpener-8052e7190810ff48a9fad1b880559c95-1] regionserver.HStore(310): Store=8052e7190810ff48a9fad1b880559c95/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:42,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:42,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8052e7190810ff48a9fad1b880559c95; next sequenceid=29; ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61982248, jitterRate=-0.0763925313949585}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:42,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8052e7190810ff48a9fad1b880559c95: 2023-07-11 18:47:42,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95., pid=142, masterSystemTime=1689101262579 2023-07-11 18:47:42,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95. 2023-07-11 18:47:42,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95. 2023-07-11 18:47:42,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2. 2023-07-11 18:47:42,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bc9b2c67e807ae977718306095e413a2, NAME => 'testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.', STARTKEY => 'row14', ENDKEY => 'row24'} 2023-07-11 18:47:42,597 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=141 updating hbase:meta row=8052e7190810ff48a9fad1b880559c95, regionState=OPEN, openSeqNum=29, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:42,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testContinuousSplitUsingLinkFile bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:42,597 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101262597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101262597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101262597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101262597"}]},"ts":"1689101262597"} 2023-07-11 18:47:42,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:42,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:42,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:42,598 INFO [StoreOpener-bc9b2c67e807ae977718306095e413a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:42,599 DEBUG [StoreOpener-bc9b2c67e807ae977718306095e413a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf 2023-07-11 18:47:42,599 DEBUG [StoreOpener-bc9b2c67e807ae977718306095e413a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf 2023-07-11 18:47:42,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=142, resume processing ppid=141 2023-07-11 18:47:42,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=142, ppid=141, state=SUCCESS; OpenRegionProcedure 8052e7190810ff48a9fad1b880559c95, server=jenkins-hbase9.apache.org,34803,1689101231723 in 171 msec 2023-07-11 18:47:42,600 INFO [StoreOpener-bc9b2c67e807ae977718306095e413a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc9b2c67e807ae977718306095e413a2 columnFamilyName cf 2023-07-11 18:47:42,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=141, ppid=137, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=8052e7190810ff48a9fad1b880559c95, ASSIGN in 327 msec 2023-07-11 18:47:42,605 DEBUG [StoreOpener-bc9b2c67e807ae977718306095e413a2-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa 2023-07-11 18:47:42,605 INFO [StoreOpener-bc9b2c67e807ae977718306095e413a2-1] regionserver.HStore(310): Store=bc9b2c67e807ae977718306095e413a2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:42,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:42,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:42,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:42,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened bc9b2c67e807ae977718306095e413a2; next sequenceid=29; ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68440783, jitterRate=0.019847139716148376}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:42,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for bc9b2c67e807ae977718306095e413a2: 2023-07-11 18:47:42,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2., pid=143, masterSystemTime=1689101262579 2023-07-11 18:47:42,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2. 2023-07-11 18:47:42,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2. 2023-07-11 18:47:42,611 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=140 updating hbase:meta row=bc9b2c67e807ae977718306095e413a2, regionState=OPEN, openSeqNum=29, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:42,612 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101262611"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101262611"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101262611"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101262611"}]},"ts":"1689101262611"} 2023-07-11 18:47:42,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=143, resume processing ppid=140 2023-07-11 18:47:42,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=143, ppid=140, state=SUCCESS; OpenRegionProcedure bc9b2c67e807ae977718306095e413a2, server=jenkins-hbase9.apache.org,34803,1689101231723 in 185 msec 2023-07-11 18:47:42,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=140, resume processing ppid=137 2023-07-11 18:47:42,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=140, ppid=137, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=bc9b2c67e807ae977718306095e413a2, ASSIGN in 341 msec 2023-07-11 18:47:42,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=137, state=SUCCESS; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=49eb6a8a2a32c73db4ac8361350664cb, daughterA=bc9b2c67e807ae977718306095e413a2, daughterB=8052e7190810ff48a9fad1b880559c95 in 564 msec 2023-07-11 18:47:45,053 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [3,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:45,055 DEBUG [Listener at localhost/44535] client.ClientScanner(240): Advancing internal scanner to startKey at 'row14', inclusive 2023-07-11 18:47:45,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34803] ipc.CallRunner(144): callId: 132 service: ClientService methodName: Scan size: 168 connection: 172.31.2.10:40030 deadline: 1689101325056, exception=org.apache.hadoop.hbase.NotServingRegionException: testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb. is not online on jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:45,161 DEBUG [Listener at localhost/44535] client.ClientScanner(240): Advancing internal scanner to startKey at 'row24', inclusive 2023-07-11 18:47:45,165 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(441): startKey=row14, getEndKey()=row24, row=row11 2023-07-11 18:47:45,165 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(441): startKey=, getEndKey()=row14, row=row11 2023-07-11 18:47:45,165 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(441): startKey=row24, getEndKey()=, row=row11 2023-07-11 18:47:45,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$3(1981): Client=jenkins//172.31.2.10 split testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. 2023-07-11 18:47:45,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:45,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=144, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=44c007c6ef70de48c276f075634e0784, daughterA=b9177219254176afda2736fa49738b3b, daughterB=4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,169 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=144, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=44c007c6ef70de48c276f075634e0784, daughterA=b9177219254176afda2736fa49738b3b, daughterB=4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,169 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=144, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=44c007c6ef70de48c276f075634e0784, daughterA=b9177219254176afda2736fa49738b3b, daughterB=4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,169 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=144, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=44c007c6ef70de48c276f075634e0784, daughterA=b9177219254176afda2736fa49738b3b, daughterB=4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=145, ppid=144, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=44c007c6ef70de48c276f075634e0784, UNASSIGN}] 2023-07-11 18:47:45,172 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=145, ppid=144, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=44c007c6ef70de48c276f075634e0784, UNASSIGN 2023-07-11 18:47:45,173 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=145 updating hbase:meta row=44c007c6ef70de48c276f075634e0784, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:45,173 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101265173"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101265173"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101265173"}]},"ts":"1689101265173"} 2023-07-11 18:47:45,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=146, ppid=145, state=RUNNABLE; CloseRegionProcedure 44c007c6ef70de48c276f075634e0784, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:45,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:45,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 44c007c6ef70de48c276f075634e0784, disabling compactions & flushes 2023-07-11 18:47:45,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. 2023-07-11 18:47:45,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. 2023-07-11 18:47:45,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. after waiting 0 ms 2023-07-11 18:47:45,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. 2023-07-11 18:47:45,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=25 2023-07-11 18:47:45,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. 2023-07-11 18:47:45,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 44c007c6ef70de48c276f075634e0784: 2023-07-11 18:47:45,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:45,334 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=145 updating hbase:meta row=44c007c6ef70de48c276f075634e0784, regionState=CLOSED 2023-07-11 18:47:45,334 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101265334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101265334"}]},"ts":"1689101265334"} 2023-07-11 18:47:45,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=146, resume processing ppid=145 2023-07-11 18:47:45,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=146, ppid=145, state=SUCCESS; CloseRegionProcedure 44c007c6ef70de48c276f075634e0784, server=jenkins-hbase9.apache.org,34803,1689101231723 in 162 msec 2023-07-11 18:47:45,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=145, resume processing ppid=144 2023-07-11 18:47:45,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=145, ppid=144, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=44c007c6ef70de48c276f075634e0784, UNASSIGN in 166 msec 2023-07-11 18:47:45,345 INFO [PEWorker-4] assignment.SplitTableRegionProcedure(694): pid=144 splitting 1 storefiles, region=44c007c6ef70de48c276f075634e0784, threads=1 2023-07-11 18:47:45,346 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=144 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b for region: 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:45,370 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=144 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b for region: 44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:45,370 DEBUG [PEWorker-4] assignment.SplitTableRegionProcedure(755): pid=144 split storefiles for region 44c007c6ef70de48c276f075634e0784 Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:45,393 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=-1 2023-07-11 18:47:45,395 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=-1 2023-07-11 18:47:45,396 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101265396"},{"qualifier":"splitA","vlen":71,"tag":[],"timestamp":"1689101265396"},{"qualifier":"splitB","vlen":76,"tag":[],"timestamp":"1689101265396"}]},"ts":"1689101265396"} 2023-07-11 18:47:45,396 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101265396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101265396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101265396"}]},"ts":"1689101265396"} 2023-07-11 18:47:45,396 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101265396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101265396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101265396"}]},"ts":"1689101265396"} 2023-07-11 18:47:45,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=147, ppid=144, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=b9177219254176afda2736fa49738b3b, ASSIGN}, {pid=148, ppid=144, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=4f3345b7e6e79f28eccaa6ee5a05a5fa, ASSIGN}] 2023-07-11 18:47:45,400 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=147, ppid=144, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=b9177219254176afda2736fa49738b3b, ASSIGN 2023-07-11 18:47:45,400 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=148, ppid=144, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=4f3345b7e6e79f28eccaa6ee5a05a5fa, ASSIGN 2023-07-11 18:47:45,400 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=147, ppid=144, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=b9177219254176afda2736fa49738b3b, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:45,400 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=148, ppid=144, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=4f3345b7e6e79f28eccaa6ee5a05a5fa, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:45,551 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:45,552 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=148 updating hbase:meta row=4f3345b7e6e79f28eccaa6ee5a05a5fa, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:45,552 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=147 updating hbase:meta row=b9177219254176afda2736fa49738b3b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:45,552 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101265552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101265552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101265552"}]},"ts":"1689101265552"} 2023-07-11 18:47:45,552 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101265552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101265552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101265552"}]},"ts":"1689101265552"} 2023-07-11 18:47:45,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=149, ppid=148, state=RUNNABLE; OpenRegionProcedure 4f3345b7e6e79f28eccaa6ee5a05a5fa, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:45,554 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=150, ppid=147, state=RUNNABLE; OpenRegionProcedure b9177219254176afda2736fa49738b3b, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:45,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b. 2023-07-11 18:47:45,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9177219254176afda2736fa49738b3b, NAME => 'testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.', STARTKEY => '', ENDKEY => 'row11'} 2023-07-11 18:47:45,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testContinuousSplitUsingLinkFile b9177219254176afda2736fa49738b3b 2023-07-11 18:47:45,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:45,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b9177219254176afda2736fa49738b3b 2023-07-11 18:47:45,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b9177219254176afda2736fa49738b3b 2023-07-11 18:47:45,710 INFO [StoreOpener-b9177219254176afda2736fa49738b3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b9177219254176afda2736fa49738b3b 2023-07-11 18:47:45,711 DEBUG [StoreOpener-b9177219254176afda2736fa49738b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf 2023-07-11 18:47:45,711 DEBUG [StoreOpener-b9177219254176afda2736fa49738b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf 2023-07-11 18:47:45,711 INFO [StoreOpener-b9177219254176afda2736fa49738b3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9177219254176afda2736fa49738b3b columnFamilyName cf 2023-07-11 18:47:45,719 DEBUG [StoreOpener-b9177219254176afda2736fa49738b3b-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b-bottom 2023-07-11 18:47:45,720 INFO [StoreOpener-b9177219254176afda2736fa49738b3b-1] regionserver.HStore(310): Store=b9177219254176afda2736fa49738b3b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:45,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b 2023-07-11 18:47:45,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b 2023-07-11 18:47:45,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b9177219254176afda2736fa49738b3b 2023-07-11 18:47:45,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b9177219254176afda2736fa49738b3b; next sequenceid=29; ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60090279, jitterRate=-0.10458506643772125}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:45,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b9177219254176afda2736fa49738b3b: 2023-07-11 18:47:45,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b., pid=150, masterSystemTime=1689101265705 2023-07-11 18:47:45,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.,because compaction is disabled. 2023-07-11 18:47:45,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b. 2023-07-11 18:47:45,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b. 2023-07-11 18:47:45,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa. 2023-07-11 18:47:45,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f3345b7e6e79f28eccaa6ee5a05a5fa, NAME => 'testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.', STARTKEY => 'row11', ENDKEY => 'row14'} 2023-07-11 18:47:45,726 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=147 updating hbase:meta row=b9177219254176afda2736fa49738b3b, regionState=OPEN, openSeqNum=29, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:45,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testContinuousSplitUsingLinkFile 4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,727 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101265726"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101265726"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101265726"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101265726"}]},"ts":"1689101265726"} 2023-07-11 18:47:45,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:45,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,728 INFO [StoreOpener-4f3345b7e6e79f28eccaa6ee5a05a5fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,729 DEBUG [StoreOpener-4f3345b7e6e79f28eccaa6ee5a05a5fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf 2023-07-11 18:47:45,729 DEBUG [StoreOpener-4f3345b7e6e79f28eccaa6ee5a05a5fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf 2023-07-11 18:47:45,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=150, resume processing ppid=147 2023-07-11 18:47:45,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=150, ppid=147, state=SUCCESS; OpenRegionProcedure b9177219254176afda2736fa49738b3b, server=jenkins-hbase9.apache.org,34803,1689101231723 in 174 msec 2023-07-11 18:47:45,729 INFO [StoreOpener-4f3345b7e6e79f28eccaa6ee5a05a5fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f3345b7e6e79f28eccaa6ee5a05a5fa columnFamilyName cf 2023-07-11 18:47:45,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=147, ppid=144, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=b9177219254176afda2736fa49738b3b, ASSIGN in 330 msec 2023-07-11 18:47:45,735 DEBUG [StoreOpener-4f3345b7e6e79f28eccaa6ee5a05a5fa-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b-top 2023-07-11 18:47:45,735 INFO [StoreOpener-4f3345b7e6e79f28eccaa6ee5a05a5fa-1] regionserver.HStore(310): Store=4f3345b7e6e79f28eccaa6ee5a05a5fa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:45,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:45,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4f3345b7e6e79f28eccaa6ee5a05a5fa; next sequenceid=29; ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60024482, jitterRate=-0.10556551814079285}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:45,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4f3345b7e6e79f28eccaa6ee5a05a5fa: 2023-07-11 18:47:45,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa., pid=149, masterSystemTime=1689101265705 2023-07-11 18:47:45,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.,because compaction is disabled. 2023-07-11 18:47:45,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa. 2023-07-11 18:47:45,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa. 2023-07-11 18:47:45,741 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=148 updating hbase:meta row=4f3345b7e6e79f28eccaa6ee5a05a5fa, regionState=OPEN, openSeqNum=29, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:45,741 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101265741"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101265741"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101265741"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101265741"}]},"ts":"1689101265741"} 2023-07-11 18:47:45,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=149, resume processing ppid=148 2023-07-11 18:47:45,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=149, ppid=148, state=SUCCESS; OpenRegionProcedure 4f3345b7e6e79f28eccaa6ee5a05a5fa, server=jenkins-hbase9.apache.org,34803,1689101231723 in 188 msec 2023-07-11 18:47:45,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=148, resume processing ppid=144 2023-07-11 18:47:45,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=148, ppid=144, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=4f3345b7e6e79f28eccaa6ee5a05a5fa, ASSIGN in 345 msec 2023-07-11 18:47:45,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=144, state=SUCCESS; SplitTableRegionProcedure table=testContinuousSplitUsingLinkFile, parent=44c007c6ef70de48c276f075634e0784, daughterA=b9177219254176afda2736fa49738b3b, daughterB=4f3345b7e6e79f28eccaa6ee5a05a5fa in 578 msec 2023-07-11 18:47:47,717 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:47:48,170 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [3,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:48,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34803] ipc.CallRunner(144): callId: 143 service: ClientService methodName: Scan size: 156 connection: 172.31.2.10:40030 deadline: 1689101328171, exception=org.apache.hadoop.hbase.NotServingRegionException: testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784. is not online on jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:48,276 DEBUG [Listener at localhost/44535] client.ClientScanner(240): Advancing internal scanner to startKey at 'row11', inclusive 2023-07-11 18:47:48,279 DEBUG [Listener at localhost/44535] client.ClientScanner(240): Advancing internal scanner to startKey at 'row14', inclusive 2023-07-11 18:47:48,280 DEBUG [Listener at localhost/44535] client.ClientScanner(240): Advancing internal scanner to startKey at 'row24', inclusive 2023-07-11 18:47:48,282 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(174): Tear down, remove table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,282 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=151, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=151 2023-07-11 18:47:48,286 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101268286"}]},"ts":"1689101268286"} 2023-07-11 18:47:48,287 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testContinuousSplitUsingLinkFile, state=DISABLING in hbase:meta 2023-07-11 18:47:48,288 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testContinuousSplitUsingLinkFile to state=DISABLING 2023-07-11 18:47:48,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=152, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=b9177219254176afda2736fa49738b3b, UNASSIGN}, {pid=153, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=4f3345b7e6e79f28eccaa6ee5a05a5fa, UNASSIGN}, {pid=154, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=bc9b2c67e807ae977718306095e413a2, UNASSIGN}, {pid=155, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=8052e7190810ff48a9fad1b880559c95, UNASSIGN}] 2023-07-11 18:47:48,290 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=152, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=b9177219254176afda2736fa49738b3b, UNASSIGN 2023-07-11 18:47:48,291 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=154, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=bc9b2c67e807ae977718306095e413a2, UNASSIGN 2023-07-11 18:47:48,291 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=153, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=4f3345b7e6e79f28eccaa6ee5a05a5fa, UNASSIGN 2023-07-11 18:47:48,291 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=155, ppid=151, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=8052e7190810ff48a9fad1b880559c95, UNASSIGN 2023-07-11 18:47:48,291 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=152 updating hbase:meta row=b9177219254176afda2736fa49738b3b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:48,291 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101268291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101268291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101268291"}]},"ts":"1689101268291"} 2023-07-11 18:47:48,291 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=154 updating hbase:meta row=bc9b2c67e807ae977718306095e413a2, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:48,291 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=155 updating hbase:meta row=8052e7190810ff48a9fad1b880559c95, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:48,291 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101268291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101268291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101268291"}]},"ts":"1689101268291"} 2023-07-11 18:47:48,291 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=153 updating hbase:meta row=4f3345b7e6e79f28eccaa6ee5a05a5fa, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:48,291 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101268291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101268291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101268291"}]},"ts":"1689101268291"} 2023-07-11 18:47:48,292 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101268291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101268291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101268291"}]},"ts":"1689101268291"} 2023-07-11 18:47:48,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=156, ppid=152, state=RUNNABLE; CloseRegionProcedure b9177219254176afda2736fa49738b3b, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:48,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=157, ppid=154, state=RUNNABLE; CloseRegionProcedure bc9b2c67e807ae977718306095e413a2, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:48,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=158, ppid=155, state=RUNNABLE; CloseRegionProcedure 8052e7190810ff48a9fad1b880559c95, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:48,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=159, ppid=153, state=RUNNABLE; CloseRegionProcedure 4f3345b7e6e79f28eccaa6ee5a05a5fa, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:48,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=151 2023-07-11 18:47:48,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:48,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8052e7190810ff48a9fad1b880559c95, disabling compactions & flushes 2023-07-11 18:47:48,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95. 2023-07-11 18:47:48,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95. 2023-07-11 18:47:48,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95. after waiting 0 ms 2023-07-11 18:47:48,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95. 2023-07-11 18:47:48,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=28 2023-07-11 18:47:48,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95. 2023-07-11 18:47:48,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8052e7190810ff48a9fad1b880559c95: 2023-07-11 18:47:48,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:48,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:48,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4f3345b7e6e79f28eccaa6ee5a05a5fa, disabling compactions & flushes 2023-07-11 18:47:48,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa. 2023-07-11 18:47:48,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa. 2023-07-11 18:47:48,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa. after waiting 0 ms 2023-07-11 18:47:48,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa. 2023-07-11 18:47:48,453 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=155 updating hbase:meta row=8052e7190810ff48a9fad1b880559c95, regionState=CLOSED 2023-07-11 18:47:48,453 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101268453"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101268453"}]},"ts":"1689101268453"} 2023-07-11 18:47:48,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=158, resume processing ppid=155 2023-07-11 18:47:48,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=158, ppid=155, state=SUCCESS; CloseRegionProcedure 8052e7190810ff48a9fad1b880559c95, server=jenkins-hbase9.apache.org,34803,1689101231723 in 160 msec 2023-07-11 18:47:48,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=28 2023-07-11 18:47:48,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=155, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=8052e7190810ff48a9fad1b880559c95, UNASSIGN in 167 msec 2023-07-11 18:47:48,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa. 2023-07-11 18:47:48,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4f3345b7e6e79f28eccaa6ee5a05a5fa: 2023-07-11 18:47:48,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:48,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b9177219254176afda2736fa49738b3b 2023-07-11 18:47:48,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b9177219254176afda2736fa49738b3b, disabling compactions & flushes 2023-07-11 18:47:48,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b. 2023-07-11 18:47:48,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b. 2023-07-11 18:47:48,460 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=153 updating hbase:meta row=4f3345b7e6e79f28eccaa6ee5a05a5fa, regionState=CLOSED 2023-07-11 18:47:48,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b. after waiting 0 ms 2023-07-11 18:47:48,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b. 2023-07-11 18:47:48,460 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101268460"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101268460"}]},"ts":"1689101268460"} 2023-07-11 18:47:48,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=28 2023-07-11 18:47:48,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b. 2023-07-11 18:47:48,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b9177219254176afda2736fa49738b3b: 2023-07-11 18:47:48,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=159, resume processing ppid=153 2023-07-11 18:47:48,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=159, ppid=153, state=SUCCESS; CloseRegionProcedure 4f3345b7e6e79f28eccaa6ee5a05a5fa, server=jenkins-hbase9.apache.org,34803,1689101231723 in 168 msec 2023-07-11 18:47:48,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b9177219254176afda2736fa49738b3b 2023-07-11 18:47:48,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:48,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing bc9b2c67e807ae977718306095e413a2, disabling compactions & flushes 2023-07-11 18:47:48,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2. 2023-07-11 18:47:48,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2. 2023-07-11 18:47:48,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=153, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=4f3345b7e6e79f28eccaa6ee5a05a5fa, UNASSIGN in 176 msec 2023-07-11 18:47:48,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2. after waiting 0 ms 2023-07-11 18:47:48,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2. 2023-07-11 18:47:48,467 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=152 updating hbase:meta row=b9177219254176afda2736fa49738b3b, regionState=CLOSED 2023-07-11 18:47:48,467 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1689101268467"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101268467"}]},"ts":"1689101268467"} 2023-07-11 18:47:48,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=156, resume processing ppid=152 2023-07-11 18:47:48,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=156, ppid=152, state=SUCCESS; CloseRegionProcedure b9177219254176afda2736fa49738b3b, server=jenkins-hbase9.apache.org,34803,1689101231723 in 176 msec 2023-07-11 18:47:48,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=28 2023-07-11 18:47:48,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=152, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=b9177219254176afda2736fa49738b3b, UNASSIGN in 180 msec 2023-07-11 18:47:48,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2. 2023-07-11 18:47:48,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for bc9b2c67e807ae977718306095e413a2: 2023-07-11 18:47:48,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:48,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=154 updating hbase:meta row=bc9b2c67e807ae977718306095e413a2, regionState=CLOSED 2023-07-11 18:47:48,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.","families":{"info":[{"qualifier":"regioninfo","vlen":76,"tag":[],"timestamp":"1689101268474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101268474"}]},"ts":"1689101268474"} 2023-07-11 18:47:48,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=157, resume processing ppid=154 2023-07-11 18:47:48,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=157, ppid=154, state=SUCCESS; CloseRegionProcedure bc9b2c67e807ae977718306095e413a2, server=jenkins-hbase9.apache.org,34803,1689101231723 in 182 msec 2023-07-11 18:47:48,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=154, resume processing ppid=151 2023-07-11 18:47:48,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=154, ppid=151, state=SUCCESS; TransitRegionStateProcedure table=testContinuousSplitUsingLinkFile, region=bc9b2c67e807ae977718306095e413a2, UNASSIGN in 188 msec 2023-07-11 18:47:48,479 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101268479"}]},"ts":"1689101268479"} 2023-07-11 18:47:48,480 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testContinuousSplitUsingLinkFile, state=DISABLED in hbase:meta 2023-07-11 18:47:48,482 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testContinuousSplitUsingLinkFile to state=DISABLED 2023-07-11 18:47:48,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=151, state=SUCCESS; DisableTableProcedure table=testContinuousSplitUsingLinkFile in 199 msec 2023-07-11 18:47:48,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=151 2023-07-11 18:47:48,588 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testContinuousSplitUsingLinkFile, procId: 151 completed 2023-07-11 18:47:48,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=160, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,591 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=160, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,592 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=160, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=160 2023-07-11 18:47:48,598 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:48,598 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:48,599 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:48,599 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:48,598 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b 2023-07-11 18:47:48,599 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:48,599 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:48,601 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits] 2023-07-11 18:47:48,602 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits] 2023-07-11 18:47:48,602 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits] 2023-07-11 18:47:48,602 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits] 2023-07-11 18:47:48,603 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits] 2023-07-11 18:47:48,603 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits] 2023-07-11 18:47:48,603 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits] 2023-07-11 18:47:48,610 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa 2023-07-11 18:47:48,610 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b 2023-07-11 18:47:48,610 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa 2023-07-11 18:47:48,610 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa 2023-07-11 18:47:48,610 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 2023-07-11 18:47:48,610 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:48,611 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:48,613 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 2023-07-11 18:47:48,613 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499 2023-07-11 18:47:48,616 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits/28.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits/28.seqid 2023-07-11 18:47:48,616 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b 2023-07-11 18:47:48,616 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits/31.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits/31.seqid 2023-07-11 18:47:48,617 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784 2023-07-11 18:47:48,617 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95 2023-07-11 18:47:48,618 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits/31.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits/31.seqid 2023-07-11 18:47:48,618 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits/31.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits/31.seqid 2023-07-11 18:47:48,618 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits/31.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits/31.seqid 2023-07-11 18:47:48,618 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2 2023-07-11 18:47:48,619 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b 2023-07-11 18:47:48,619 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa 2023-07-11 18:47:48,619 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits/28.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits/28.seqid 2023-07-11 18:47:48,620 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb 2023-07-11 18:47:48,621 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits/25.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits/25.seqid 2023-07-11 18:47:48,621 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 2023-07-11 18:47:48,621 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testContinuousSplitUsingLinkFile regions 2023-07-11 18:47:48,623 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=160, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,626 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 7 rows of testContinuousSplitUsingLinkFile from hbase:meta 2023-07-11 18:47:48,628 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testContinuousSplitUsingLinkFile' descriptor. 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=160, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testContinuousSplitUsingLinkFile' from region states. 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101268629"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101268629"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101268629"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101268629"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101268629"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101268629"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:48,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101268629"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:48,631 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 7 regions from META 2023-07-11 18:47:48,631 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ccfdcfcce076ae8d4eba487c11557fc3, NAME => 'testContinuousSplitUsingLinkFile,,1689101257800.ccfdcfcce076ae8d4eba487c11557fc3.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 44c007c6ef70de48c276f075634e0784, NAME => 'testContinuousSplitUsingLinkFile,,1689101258934.44c007c6ef70de48c276f075634e0784.', STARTKEY => '', ENDKEY => 'row14'}, {ENCODED => b9177219254176afda2736fa49738b3b, NAME => 'testContinuousSplitUsingLinkFile,,1689101265167.b9177219254176afda2736fa49738b3b.', STARTKEY => '', ENDKEY => 'row11'}, {ENCODED => 4f3345b7e6e79f28eccaa6ee5a05a5fa, NAME => 'testContinuousSplitUsingLinkFile,row11,1689101265167.4f3345b7e6e79f28eccaa6ee5a05a5fa.', STARTKEY => 'row11', ENDKEY => 'row14'}, {ENCODED => 49eb6a8a2a32c73db4ac8361350664cb, NAME => 'testContinuousSplitUsingLinkFile,row14,1689101258934.49eb6a8a2a32c73db4ac8361350664cb.', STARTKEY => 'row14', ENDKEY => ''}, {ENCODED => bc9b2c67e807ae977718306095e413a2, NAME => 'testContinuousSplitUsingLinkFile,row14,1689101262051.bc9b2c67e807ae977718306095e413a2.', STARTKEY => 'row14', ENDKEY => 'row24'}, {ENCODED => 8052e7190810ff48a9fad1b880559c95, NAME => 'testContinuousSplitUsingLinkFile,row24,1689101262051.8052e7190810ff48a9fad1b880559c95.', STARTKEY => 'row24', ENDKEY => ''}] 2023-07-11 18:47:48,631 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testContinuousSplitUsingLinkFile' as deleted. 2023-07-11 18:47:48,631 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testContinuousSplitUsingLinkFile","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101268631"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:48,632 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testContinuousSplitUsingLinkFile state from META 2023-07-11 18:47:48,634 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=160, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testContinuousSplitUsingLinkFile 2023-07-11 18:47:48,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=160, state=SUCCESS; DeleteTableProcedure table=testContinuousSplitUsingLinkFile in 45 msec 2023-07-11 18:47:48,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=160 2023-07-11 18:47:48,693 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testContinuousSplitUsingLinkFile, procId: 160 completed 2023-07-11 18:47:48,708 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testContinuousSplitUsingLinkFile Thread=427 (was 431), OpenFileDescriptor=760 (was 816), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 242), ProcessCount=170 (was 170), AvailableMemoryMB=7662 (was 7675) 2023-07-11 18:47:48,721 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck Thread=427, OpenFileDescriptor=760, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=170, AvailableMemoryMB=7661 2023-07-11 18:47:48,722 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:48,722 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:48,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster$CustomSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'i_f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:48,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=161, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:48,726 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=161, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:48,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck" procId is: 161 2023-07-11 18:47:48,727 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=161, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:48,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=161 2023-07-11 18:47:48,728 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:48,729 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 empty. 2023-07-11 18:47:48,729 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:48,729 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck regions 2023-07-11 18:47:48,739 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:48,740 INFO [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(7675): creating {ENCODED => fece31c14c6aaa1af9eb8ab1ce6d3cd8, NAME => 'testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster$CustomSplitPolicy'}}}, {NAME => 'f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'i_f', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:48,747 DEBUG [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(866): Instantiated testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:48,747 DEBUG [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(1604): Closing fece31c14c6aaa1af9eb8ab1ce6d3cd8, disabling compactions & flushes 2023-07-11 18:47:48,747 INFO [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(1626): Closing region testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:48,747 DEBUG [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:48,747 DEBUG [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(1714): Acquired close lock on testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. after waiting 0 ms 2023-07-11 18:47:48,747 DEBUG [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(1724): Updates disabled for region testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:48,747 INFO [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(1838): Closed testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:48,747 DEBUG [RegionOpenAndInit-testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck-pool-0] regionserver.HRegion(1558): Region close journal for fece31c14c6aaa1af9eb8ab1ce6d3cd8: 2023-07-11 18:47:48,749 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=161, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:48,750 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":99,"tag":[],"timestamp":"1689101268750"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101268750"}]},"ts":"1689101268750"} 2023-07-11 18:47:48,751 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:48,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=161, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:48,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101268752"}]},"ts":"1689101268752"} 2023-07-11 18:47:48,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, state=ENABLING in hbase:meta 2023-07-11 18:47:48,757 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:48,758 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:48,758 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:48,758 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:48,758 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:48,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=162, ppid=161, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, region=fece31c14c6aaa1af9eb8ab1ce6d3cd8, ASSIGN}] 2023-07-11 18:47:48,760 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=162, ppid=161, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, region=fece31c14c6aaa1af9eb8ab1ce6d3cd8, ASSIGN 2023-07-11 18:47:48,761 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=162, ppid=161, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, region=fece31c14c6aaa1af9eb8ab1ce6d3cd8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33849,1689101240752; forceNewPlan=false, retain=false 2023-07-11 18:47:48,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=161 2023-07-11 18:47:48,912 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:48,913 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=162 updating hbase:meta row=fece31c14c6aaa1af9eb8ab1ce6d3cd8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:48,913 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":99,"tag":[],"timestamp":"1689101268913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101268913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101268913"}]},"ts":"1689101268913"} 2023-07-11 18:47:48,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=163, ppid=162, state=RUNNABLE; OpenRegionProcedure fece31c14c6aaa1af9eb8ab1ce6d3cd8, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:49,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=161 2023-07-11 18:47:49,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:49,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fece31c14c6aaa1af9eb8ab1ce6d3cd8, NAME => 'testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,074 INFO [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f of region fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,076 DEBUG [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f 2023-07-11 18:47:49,076 DEBUG [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f 2023-07-11 18:47:49,076 INFO [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fece31c14c6aaa1af9eb8ab1ce6d3cd8 columnFamilyName f 2023-07-11 18:47:49,077 INFO [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] regionserver.HStore(310): Store=fece31c14c6aaa1af9eb8ab1ce6d3cd8/f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:49,077 INFO [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family i_f of region fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,078 DEBUG [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f 2023-07-11 18:47:49,078 DEBUG [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f 2023-07-11 18:47:49,079 INFO [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fece31c14c6aaa1af9eb8ab1ce6d3cd8 columnFamilyName i_f 2023-07-11 18:47:49,079 INFO [StoreOpener-fece31c14c6aaa1af9eb8ab1ce6d3cd8-1] regionserver.HStore(310): Store=fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:49,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-07-11 18:47:49,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:49,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened fece31c14c6aaa1af9eb8ab1ce6d3cd8; next sequenceid=2; IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70161221, jitterRate=0.04548366367816925}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-07-11 18:47:49,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for fece31c14c6aaa1af9eb8ab1ce6d3cd8: 2023-07-11 18:47:49,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8., pid=163, masterSystemTime=1689101269066 2023-07-11 18:47:49,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:49,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:49,088 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=162 updating hbase:meta row=fece31c14c6aaa1af9eb8ab1ce6d3cd8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:49,088 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":99,"tag":[],"timestamp":"1689101269088"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101269088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101269088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101269088"}]},"ts":"1689101269088"} 2023-07-11 18:47:49,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=163, resume processing ppid=162 2023-07-11 18:47:49,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=163, ppid=162, state=SUCCESS; OpenRegionProcedure fece31c14c6aaa1af9eb8ab1ce6d3cd8, server=jenkins-hbase9.apache.org,33849,1689101240752 in 175 msec 2023-07-11 18:47:49,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=162, resume processing ppid=161 2023-07-11 18:47:49,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=162, ppid=161, state=SUCCESS; TransitRegionStateProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, region=fece31c14c6aaa1af9eb8ab1ce6d3cd8, ASSIGN in 333 msec 2023-07-11 18:47:49,095 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=161, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:49,095 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101269095"}]},"ts":"1689101269095"} 2023-07-11 18:47:49,096 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, state=ENABLED in hbase:meta 2023-07-11 18:47:49,098 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=161, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:49,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=161, state=SUCCESS; CreateTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck in 374 msec 2023-07-11 18:47:49,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=161 2023-07-11 18:47:49,331 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, procId: 161 completed 2023-07-11 18:47:49,335 INFO [Listener at localhost/44535] regionserver.HRegion(2745): Flushing fece31c14c6aaa1af9eb8ab1ce6d3cd8 2/2 column families, dataSize=396 B heapSize=1.77 KB 2023-07-11 18:47:49,348 INFO [Listener at localhost/44535] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=10 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/.tmp/f/f16736fb656943859665ea2817773bb6 2023-07-11 18:47:49,362 INFO [Listener at localhost/44535] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=204 B at sequenceid=10 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/.tmp/i_f/ba572f8d4db74a35a7f498c3d96ca27b 2023-07-11 18:47:49,367 DEBUG [Listener at localhost/44535] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/.tmp/f/f16736fb656943859665ea2817773bb6 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f/f16736fb656943859665ea2817773bb6 2023-07-11 18:47:49,372 INFO [Listener at localhost/44535] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f/f16736fb656943859665ea2817773bb6, entries=6, sequenceid=10, filesize=4.9 K 2023-07-11 18:47:49,372 DEBUG [Listener at localhost/44535] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/.tmp/i_f/ba572f8d4db74a35a7f498c3d96ca27b as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f/ba572f8d4db74a35a7f498c3d96ca27b 2023-07-11 18:47:49,377 INFO [Listener at localhost/44535] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f/ba572f8d4db74a35a7f498c3d96ca27b, entries=6, sequenceid=10, filesize=4.9 K 2023-07-11 18:47:49,378 INFO [Listener at localhost/44535] regionserver.HRegion(2948): Finished flush of dataSize ~396 B/396, heapSize ~1.73 KB/1776, currentSize=0 B/0 for fece31c14c6aaa1af9eb8ab1ce6d3cd8 in 43ms, sequenceid=10, compaction requested=false 2023-07-11 18:47:49,378 DEBUG [Listener at localhost/44535] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck' 2023-07-11 18:47:49,379 DEBUG [Listener at localhost/44535] regionserver.HRegion(2446): Flush status journal for fece31c14c6aaa1af9eb8ab1ce6d3cd8: 2023-07-11 18:47:49,387 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=164, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=164 2023-07-11 18:47:49,391 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101269391"}]},"ts":"1689101269391"} 2023-07-11 18:47:49,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, state=DISABLING in hbase:meta 2023-07-11 18:47:49,393 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck to state=DISABLING 2023-07-11 18:47:49,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=165, ppid=164, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, region=fece31c14c6aaa1af9eb8ab1ce6d3cd8, UNASSIGN}] 2023-07-11 18:47:49,398 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=165, ppid=164, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, region=fece31c14c6aaa1af9eb8ab1ce6d3cd8, UNASSIGN 2023-07-11 18:47:49,399 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=165 updating hbase:meta row=fece31c14c6aaa1af9eb8ab1ce6d3cd8, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:49,399 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":99,"tag":[],"timestamp":"1689101269399"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101269399"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101269399"}]},"ts":"1689101269399"} 2023-07-11 18:47:49,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=166, ppid=165, state=RUNNABLE; CloseRegionProcedure fece31c14c6aaa1af9eb8ab1ce6d3cd8, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:49,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=164 2023-07-11 18:47:49,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing fece31c14c6aaa1af9eb8ab1ce6d3cd8, disabling compactions & flushes 2023-07-11 18:47:49,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:49,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:49,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. after waiting 0 ms 2023-07-11 18:47:49,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:49,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits/13.seqid, newMaxSeqId=13, maxSeqId=1 2023-07-11 18:47:49,557 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8. 2023-07-11 18:47:49,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for fece31c14c6aaa1af9eb8ab1ce6d3cd8: 2023-07-11 18:47:49,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=165 updating hbase:meta row=fece31c14c6aaa1af9eb8ab1ce6d3cd8, regionState=CLOSED 2023-07-11 18:47:49,559 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.","families":{"info":[{"qualifier":"regioninfo","vlen":99,"tag":[],"timestamp":"1689101269559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101269559"}]},"ts":"1689101269559"} 2023-07-11 18:47:49,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=166, resume processing ppid=165 2023-07-11 18:47:49,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=166, ppid=165, state=SUCCESS; CloseRegionProcedure fece31c14c6aaa1af9eb8ab1ce6d3cd8, server=jenkins-hbase9.apache.org,33849,1689101240752 in 160 msec 2023-07-11 18:47:49,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=165, resume processing ppid=164 2023-07-11 18:47:49,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=165, ppid=164, state=SUCCESS; TransitRegionStateProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, region=fece31c14c6aaa1af9eb8ab1ce6d3cd8, UNASSIGN in 167 msec 2023-07-11 18:47:49,563 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101269563"}]},"ts":"1689101269563"} 2023-07-11 18:47:49,564 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, state=DISABLED in hbase:meta 2023-07-11 18:47:49,567 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck to state=DISABLED 2023-07-11 18:47:49,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=164, state=SUCCESS; DisableTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck in 179 msec 2023-07-11 18:47:49,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=164 2023-07-11 18:47:49,693 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, procId: 164 completed 2023-07-11 18:47:49,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=167, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,696 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=167, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,696 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=167, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=167 2023-07-11 18:47:49,699 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,701 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits] 2023-07-11 18:47:49,705 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f/f16736fb656943859665ea2817773bb6 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f/f16736fb656943859665ea2817773bb6 2023-07-11 18:47:49,707 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f/ba572f8d4db74a35a7f498c3d96ca27b to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f/ba572f8d4db74a35a7f498c3d96ca27b 2023-07-11 18:47:49,709 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits/13.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits/13.seqid 2023-07-11 18:47:49,710 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 2023-07-11 18:47:49,710 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck regions 2023-07-11 18:47:49,712 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=167, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,714 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck from hbase:meta 2023-07-11 18:47:49,715 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck' descriptor. 2023-07-11 18:47:49,716 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=167, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,716 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck' from region states. 2023-07-11 18:47:49,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101269716"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:49,717 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 18:47:49,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fece31c14c6aaa1af9eb8ab1ce6d3cd8, NAME => 'testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck,,1689101268724.fece31c14c6aaa1af9eb8ab1ce6d3cd8.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 18:47:49,718 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck' as deleted. 2023-07-11 18:47:49,718 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101269718"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:49,719 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck state from META 2023-07-11 18:47:49,720 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=167, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck 2023-07-11 18:47:49,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=167, state=SUCCESS; DeleteTableProcedure table=testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck in 26 msec 2023-07-11 18:47:49,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=167 2023-07-11 18:47:49,798 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck, procId: 167 completed 2023-07-11 18:47:49,814 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck Thread=431 (was 427) - Thread LEAK? -, OpenFileDescriptor=750 (was 760), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 204), ProcessCount=170 (was 170), AvailableMemoryMB=7652 (was 7661) 2023-07-11 18:47:49,828 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testSplitRegionWithNoStoreFiles Thread=431, OpenFileDescriptor=750, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=170, AvailableMemoryMB=7652 2023-07-11 18:47:49,828 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:49,828 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:49,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testSplitRegionWithNoStoreFiles', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:49,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=168, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:49,833 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=168, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testSplitRegionWithNoStoreFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:49,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testSplitRegionWithNoStoreFiles" procId is: 168 2023-07-11 18:47:49,833 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=168, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testSplitRegionWithNoStoreFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:49,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=168 2023-07-11 18:47:49,835 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:49,835 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f empty. 2023-07-11 18:47:49,836 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:49,836 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testSplitRegionWithNoStoreFiles regions 2023-07-11 18:47:49,846 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:49,847 INFO [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec8272f528aea999d0996151be5adb6f, NAME => 'testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testSplitRegionWithNoStoreFiles', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:49,854 DEBUG [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(866): Instantiated testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:49,855 DEBUG [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(1604): Closing ec8272f528aea999d0996151be5adb6f, disabling compactions & flushes 2023-07-11 18:47:49,855 INFO [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(1626): Closing region testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:49,855 DEBUG [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:49,855 DEBUG [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. after waiting 0 ms 2023-07-11 18:47:49,855 DEBUG [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:49,855 INFO [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(1838): Closed testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:49,855 DEBUG [RegionOpenAndInit-testSplitRegionWithNoStoreFiles-pool-0] regionserver.HRegion(1558): Region close journal for ec8272f528aea999d0996151be5adb6f: 2023-07-11 18:47:49,856 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=168, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testSplitRegionWithNoStoreFiles execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:49,857 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101269857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101269857"}]},"ts":"1689101269857"} 2023-07-11 18:47:49,858 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:49,859 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=168, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testSplitRegionWithNoStoreFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:49,859 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitRegionWithNoStoreFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101269859"}]},"ts":"1689101269859"} 2023-07-11 18:47:49,860 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testSplitRegionWithNoStoreFiles, state=ENABLING in hbase:meta 2023-07-11 18:47:49,863 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:49,863 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:49,863 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:49,863 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:49,863 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:49,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=169, ppid=168, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ec8272f528aea999d0996151be5adb6f, ASSIGN}] 2023-07-11 18:47:49,865 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=169, ppid=168, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ec8272f528aea999d0996151be5adb6f, ASSIGN 2023-07-11 18:47:49,866 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=169, ppid=168, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ec8272f528aea999d0996151be5adb6f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:49,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=168 2023-07-11 18:47:50,016 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:50,017 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=169 updating hbase:meta row=ec8272f528aea999d0996151be5adb6f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:50,017 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101270017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101270017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101270017"}]},"ts":"1689101270017"} 2023-07-11 18:47:50,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=170, ppid=169, state=RUNNABLE; OpenRegionProcedure ec8272f528aea999d0996151be5adb6f, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:50,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=168 2023-07-11 18:47:50,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:50,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec8272f528aea999d0996151be5adb6f, NAME => 'testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:50,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitRegionWithNoStoreFiles ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:50,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,175 INFO [StoreOpener-ec8272f528aea999d0996151be5adb6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,176 DEBUG [StoreOpener-ec8272f528aea999d0996151be5adb6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/info 2023-07-11 18:47:50,176 DEBUG [StoreOpener-ec8272f528aea999d0996151be5adb6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/info 2023-07-11 18:47:50,177 INFO [StoreOpener-ec8272f528aea999d0996151be5adb6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec8272f528aea999d0996151be5adb6f columnFamilyName info 2023-07-11 18:47:50,177 INFO [StoreOpener-ec8272f528aea999d0996151be5adb6f-1] regionserver.HStore(310): Store=ec8272f528aea999d0996151be5adb6f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:50,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:50,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ec8272f528aea999d0996151be5adb6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70054389, jitterRate=0.04389174282550812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:50,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ec8272f528aea999d0996151be5adb6f: 2023-07-11 18:47:50,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f., pid=170, masterSystemTime=1689101270170 2023-07-11 18:47:50,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:50,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:50,185 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=169 updating hbase:meta row=ec8272f528aea999d0996151be5adb6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:50,185 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101270185"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101270185"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101270185"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101270185"}]},"ts":"1689101270185"} 2023-07-11 18:47:50,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=170, resume processing ppid=169 2023-07-11 18:47:50,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=170, ppid=169, state=SUCCESS; OpenRegionProcedure ec8272f528aea999d0996151be5adb6f, server=jenkins-hbase9.apache.org,40505,1689101231800 in 167 msec 2023-07-11 18:47:50,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=169, resume processing ppid=168 2023-07-11 18:47:50,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=169, ppid=168, state=SUCCESS; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ec8272f528aea999d0996151be5adb6f, ASSIGN in 323 msec 2023-07-11 18:47:50,189 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=168, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testSplitRegionWithNoStoreFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:50,189 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitRegionWithNoStoreFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101270189"}]},"ts":"1689101270189"} 2023-07-11 18:47:50,190 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testSplitRegionWithNoStoreFiles, state=ENABLED in hbase:meta 2023-07-11 18:47:50,193 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=168, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testSplitRegionWithNoStoreFiles execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:50,194 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=168, state=SUCCESS; CreateTableProcedure table=testSplitRegionWithNoStoreFiles in 362 msec 2023-07-11 18:47:50,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=168 2023-07-11 18:47:50,438 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testSplitRegionWithNoStoreFiles, procId: 168 completed 2023-07-11 18:47:50,438 DEBUG [Listener at localhost/44535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testSplitRegionWithNoStoreFiles get assigned. Timeout = 60000ms 2023-07-11 18:47:50,438 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:50,440 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=34803] regionserver.StoreScanner(1093): Switch to stream read (scanned=32882 bytes) of info 2023-07-11 18:47:50,445 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3484): All regions for table testSplitRegionWithNoStoreFiles assigned to meta. Checking AM states. 2023-07-11 18:47:50,445 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:50,445 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3504): All regions for table testSplitRegionWithNoStoreFiles assigned. 2023-07-11 18:47:50,445 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:50,446 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:50,446 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1032): MetaRegionServer=jenkins-hbase9.apache.org,34803,1689101231723, other=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:50,448 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:50,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=false 2023-07-11 18:47:50,448 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(1078): Initial regions: testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. / hdfs://localhost:33811/user hdfs://localhost:33811/user/jenkins hdfs://localhost:33811/user/jenkins/test-data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.hbck hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/hbase-hbck.lock hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,36851,1689101253218 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,36851,1689101253218/jenkins-hbase9.apache.org%2C36851%2C1689101253218.1689101253292 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/archive hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/01a92f6468964ebcbae9325df6cd20e7 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c86e7974d3549eb9479307bd856b464 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/809.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/oldWALs hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,33849,1689101240752 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,33849,1689101240752/jenkins-hbase9.apache.org%2C33849%2C1689101240752.1689101240946 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723/jenkins-hbase9.apache.org%2C34803%2C1689101231723.1689101233268 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723/jenkins-hbase9.apache.org%2C34803%2C1689101231723.meta.1689101233438.meta hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,40505,1689101231800 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,40505,1689101231800/jenkins-hbase9.apache.org%2C40505%2C1689101231800.1689101233268 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits/28.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits/28.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits/31.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits/31.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits/31.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits/31.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-4a0b2d1dba3d4a34abcc61a773d34aaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-4a0b2d1dba3d4a34abcc61a773d34aaa/49eb6a8a2a32c73db4ac8361350664cb.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-4a0b2d1dba3d4a34abcc61a773d34aaa/bc9b2c67e807ae977718306095e413a2.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-51adb46ba2224c2980adab43d6be3499 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-51adb46ba2224c2980adab43d6be3499/49eb6a8a2a32c73db4ac8361350664cb.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-51adb46ba2224c2980adab43d6be3499/8052e7190810ff48a9fad1b880559c95.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-97dcdea10c3e468e9cdf494c164cb57b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-97dcdea10c3e468e9cdf494c164cb57b/44c007c6ef70de48c276f075634e0784.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits/25.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits/11.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/96ec7655b4fa460c832befde88bf622a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/b1636f999510484da9a00512fd3a59f0 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits/16.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/82cb42e3ff0b471d8325c8bf44538dd2 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/b7404d8a335947a3925c1032d6e0c57b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits/16.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/.links-8771ccf059bc4608b6fc484c5097c514 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/.links-8771ccf059bc4608b6fc484c5097c514/b15cc040ddc70423471a965482842fb6.testRITStateForRollback hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits/14.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/f51a873bfcd34fed826bf0fd7b9100c1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000012 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/13.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/14e83e6b39134f7c8ee3cc338dec97e4 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/19.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/89bbe1f4b18c43a19d882029ceb29096 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/19.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/898b5951b57d41b3b5453c0c45df2556 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/14.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits/8.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2cbeb3f513534543878f017c83520c26 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits/23.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits/19.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/9e135334a6af4c75b9715bc7bd0aca23 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits/23.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/a8001c77281946268bba24e3bdea3d67 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits/15.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/88c0a87656904167b14b2df2f6130877 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits/15.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits/11.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/70acab94f6e84a28ba917c73dc325c12 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits/63.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/76f51ff2cc8f40128abf12210dbb5a16 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits/63.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/03a785c75f504434b0a4a8935ba4db56 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/25464e50e9fa41249a2adc6f11771828 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/43308d3e9e75477c8b7911ffffe6a993 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/479e3ad5bee6454597090224a4832898 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/82077d9e77be4aa9a3936de33fca5b85 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/8bd255be04e549da827960e877aeb20f hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ace268f8c9604569a46924f822aee302 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/af5e63ac1bf7443da10d7570ed15c5ff hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ba0d674e65644b9e81f477b9fc2ad703 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c167e1d44f0944e090551070463e26a7 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c3f69e0b68e94f4bb3d4fe55791c839d hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/d897f49f751449c282dc723b35f3748e hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/e4f5758207d34fae83be9bec50400aee hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits/59.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f/f16736fb656943859665ea2817773bb6 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f/ba572f8d4db74a35a7f498c3d96ca27b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits/13.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/corrupt hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/.tabledesc hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/.tabledesc/.tableinfo.0000000001 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/.tmp hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits/1.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/.tabledesc hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/.tmp hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/recovered.edits/1.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/rep_barrier hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/table hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/.tabledesc hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/.tmp hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/recovered.edits/1.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/hbase.id hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/hbase.version hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/mobdir hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/staging 2023-07-11 18:47:50,663 INFO [Listener at localhost/44535] master.HMaster$3(1981): Client=null/null split testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:50,664 DEBUG [Listener at localhost/44535] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:50,665 DEBUG [Listener at localhost/44535] procedure2.ProcedureExecutor(1029): Stored pid=171, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitRegionWithNoStoreFiles, parent=ec8272f528aea999d0996151be5adb6f, daughterA=a8e19ae84d21b1873bb824f123014179, daughterB=ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:50,666 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=171, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitRegionWithNoStoreFiles, parent=ec8272f528aea999d0996151be5adb6f, daughterA=a8e19ae84d21b1873bb824f123014179, daughterB=ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:50,666 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=171, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitRegionWithNoStoreFiles, parent=ec8272f528aea999d0996151be5adb6f, daughterA=a8e19ae84d21b1873bb824f123014179, daughterB=ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:50,666 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=171, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitRegionWithNoStoreFiles, parent=ec8272f528aea999d0996151be5adb6f, daughterA=a8e19ae84d21b1873bb824f123014179, daughterB=ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:50,668 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=172, ppid=171, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ec8272f528aea999d0996151be5adb6f, UNASSIGN}] 2023-07-11 18:47:50,669 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=172, ppid=171, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ec8272f528aea999d0996151be5adb6f, UNASSIGN 2023-07-11 18:47:50,670 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=172 updating hbase:meta row=ec8272f528aea999d0996151be5adb6f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:50,670 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101270670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101270670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101270670"}]},"ts":"1689101270670"} 2023-07-11 18:47:50,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=173, ppid=172, state=RUNNABLE; CloseRegionProcedure ec8272f528aea999d0996151be5adb6f, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:50,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ec8272f528aea999d0996151be5adb6f, disabling compactions & flushes 2023-07-11 18:47:50,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:50,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:50,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. after waiting 0 ms 2023-07-11 18:47:50,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:50,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2023-07-11 18:47:50,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f. 2023-07-11 18:47:50,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ec8272f528aea999d0996151be5adb6f: 2023-07-11 18:47:50,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:50,830 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=172 updating hbase:meta row=ec8272f528aea999d0996151be5adb6f, regionState=CLOSED 2023-07-11 18:47:50,830 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101270830"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101270830"}]},"ts":"1689101270830"} 2023-07-11 18:47:50,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=173, resume processing ppid=172 2023-07-11 18:47:50,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=173, ppid=172, state=SUCCESS; CloseRegionProcedure ec8272f528aea999d0996151be5adb6f, server=jenkins-hbase9.apache.org,40505,1689101231800 in 160 msec 2023-07-11 18:47:50,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=172, resume processing ppid=171 2023-07-11 18:47:50,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=172, ppid=171, state=SUCCESS; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ec8272f528aea999d0996151be5adb6f, UNASSIGN in 164 msec 2023-07-11 18:47:50,859 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=-1 2023-07-11 18:47:50,860 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=-1 2023-07-11 18:47:50,862 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101270862"},{"qualifier":"splitA","vlen":69,"tag":[],"timestamp":"1689101270862"},{"qualifier":"splitB","vlen":69,"tag":[],"timestamp":"1689101270862"}]},"ts":"1689101270862"} 2023-07-11 18:47:50,862 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101270862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101270862"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101270862"}]},"ts":"1689101270862"} 2023-07-11 18:47:50,862 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101270862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101270862"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101270862"}]},"ts":"1689101270862"} 2023-07-11 18:47:50,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=174, ppid=171, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=a8e19ae84d21b1873bb824f123014179, ASSIGN}, {pid=175, ppid=171, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ea870051f419fd438db2b9d65c6d3296, ASSIGN}] 2023-07-11 18:47:50,865 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=175, ppid=171, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ea870051f419fd438db2b9d65c6d3296, ASSIGN 2023-07-11 18:47:50,865 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=174, ppid=171, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=a8e19ae84d21b1873bb824f123014179, ASSIGN 2023-07-11 18:47:50,866 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=175, ppid=171, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ea870051f419fd438db2b9d65c6d3296, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:50,866 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=174, ppid=171, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=a8e19ae84d21b1873bb824f123014179, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:51,016 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:51,018 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=174 updating hbase:meta row=a8e19ae84d21b1873bb824f123014179, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:51,018 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=175 updating hbase:meta row=ea870051f419fd438db2b9d65c6d3296, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:51,018 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101271018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101271018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101271018"}]},"ts":"1689101271018"} 2023-07-11 18:47:51,018 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101271018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101271018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101271018"}]},"ts":"1689101271018"} 2023-07-11 18:47:51,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=176, ppid=174, state=RUNNABLE; OpenRegionProcedure a8e19ae84d21b1873bb824f123014179, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:51,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=177, ppid=175, state=RUNNABLE; OpenRegionProcedure ea870051f419fd438db2b9d65c6d3296, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:51,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296. 2023-07-11 18:47:51,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea870051f419fd438db2b9d65c6d3296, NAME => 'testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.', STARTKEY => 'row2', ENDKEY => ''} 2023-07-11 18:47:51,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitRegionWithNoStoreFiles ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:51,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,176 INFO [StoreOpener-ea870051f419fd438db2b9d65c6d3296-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,177 DEBUG [StoreOpener-ea870051f419fd438db2b9d65c6d3296-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/info 2023-07-11 18:47:51,177 DEBUG [StoreOpener-ea870051f419fd438db2b9d65c6d3296-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/info 2023-07-11 18:47:51,177 INFO [StoreOpener-ea870051f419fd438db2b9d65c6d3296-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea870051f419fd438db2b9d65c6d3296 columnFamilyName info 2023-07-11 18:47:51,179 INFO [StoreOpener-ea870051f419fd438db2b9d65c6d3296-1] regionserver.HStore(310): Store=ea870051f419fd438db2b9d65c6d3296/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:51,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ea870051f419fd438db2b9d65c6d3296; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74925333, jitterRate=0.1164744645357132}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:51,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ea870051f419fd438db2b9d65c6d3296: 2023-07-11 18:47:51,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296., pid=177, masterSystemTime=1689101271171 2023-07-11 18:47:51,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296. 2023-07-11 18:47:51,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296. 2023-07-11 18:47:51,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179. 2023-07-11 18:47:51,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a8e19ae84d21b1873bb824f123014179, NAME => 'testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.', STARTKEY => '', ENDKEY => 'row2'} 2023-07-11 18:47:51,186 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=175 updating hbase:meta row=ea870051f419fd438db2b9d65c6d3296, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:51,186 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101271186"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101271186"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101271186"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101271186"}]},"ts":"1689101271186"} 2023-07-11 18:47:51,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitRegionWithNoStoreFiles a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:51,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,187 INFO [StoreOpener-a8e19ae84d21b1873bb824f123014179-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=177, resume processing ppid=175 2023-07-11 18:47:51,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=177, ppid=175, state=SUCCESS; OpenRegionProcedure ea870051f419fd438db2b9d65c6d3296, server=jenkins-hbase9.apache.org,40505,1689101231800 in 167 msec 2023-07-11 18:47:51,189 DEBUG [StoreOpener-a8e19ae84d21b1873bb824f123014179-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/info 2023-07-11 18:47:51,189 DEBUG [StoreOpener-a8e19ae84d21b1873bb824f123014179-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/info 2023-07-11 18:47:51,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=175, ppid=171, state=SUCCESS; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ea870051f419fd438db2b9d65c6d3296, ASSIGN in 323 msec 2023-07-11 18:47:51,190 INFO [StoreOpener-a8e19ae84d21b1873bb824f123014179-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8e19ae84d21b1873bb824f123014179 columnFamilyName info 2023-07-11 18:47:51,190 INFO [StoreOpener-a8e19ae84d21b1873bb824f123014179-1] regionserver.HStore(310): Store=a8e19ae84d21b1873bb824f123014179/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:51,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a8e19ae84d21b1873bb824f123014179; next sequenceid=5; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73286347, jitterRate=0.0920516699552536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:51,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a8e19ae84d21b1873bb824f123014179: 2023-07-11 18:47:51,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179., pid=176, masterSystemTime=1689101271171 2023-07-11 18:47:51,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179. 2023-07-11 18:47:51,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179. 2023-07-11 18:47:51,198 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=174 updating hbase:meta row=a8e19ae84d21b1873bb824f123014179, regionState=OPEN, openSeqNum=5, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:51,198 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101271198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101271198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101271198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101271198"}]},"ts":"1689101271198"} 2023-07-11 18:47:51,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=176, resume processing ppid=174 2023-07-11 18:47:51,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=176, ppid=174, state=SUCCESS; OpenRegionProcedure a8e19ae84d21b1873bb824f123014179, server=jenkins-hbase9.apache.org,40505,1689101231800 in 180 msec 2023-07-11 18:47:51,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=174, resume processing ppid=171 2023-07-11 18:47:51,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=174, ppid=171, state=SUCCESS; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=a8e19ae84d21b1873bb824f123014179, ASSIGN in 335 msec 2023-07-11 18:47:51,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=171, state=SUCCESS; SplitTableRegionProcedure table=testSplitRegionWithNoStoreFiles, parent=ec8272f528aea999d0996151be5adb6f, daughterA=a8e19ae84d21b1873bb824f123014179, daughterB=ea870051f419fd438db2b9d65c6d3296 in 538 msec / hdfs://localhost:33811/user hdfs://localhost:33811/user/jenkins hdfs://localhost:33811/user/jenkins/test-data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.hbck hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/hbase-hbck.lock hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,36851,1689101253218 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/WALs/jenkins-hbase9.apache.org,36851,1689101253218/jenkins-hbase9.apache.org%2C36851%2C1689101253218.1689101253292 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/archive hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/01a92f6468964ebcbae9325df6cd20e7 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c86e7974d3549eb9479307bd856b464 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/809.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.wals hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/oldWALs hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,33849,1689101240752 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,33849,1689101240752/jenkins-hbase9.apache.org%2C33849%2C1689101240752.1689101240946 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723/jenkins-hbase9.apache.org%2C34803%2C1689101231723.1689101233268 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,34803,1689101231723/jenkins-hbase9.apache.org%2C34803%2C1689101231723.meta.1689101233438.meta hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,40505,1689101231800 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/WALs/jenkins-hbase9.apache.org,40505,1689101231800/jenkins-hbase9.apache.org%2C40505%2C1689101231800.1689101233268 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/44c007c6ef70de48c276f075634e0784/recovered.edits/28.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/49eb6a8a2a32c73db4ac8361350664cb/recovered.edits/28.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/4f3345b7e6e79f28eccaa6ee5a05a5fa/recovered.edits/31.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-51adb46ba2224c2980adab43d6be3499 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/8052e7190810ff48a9fad1b880559c95/recovered.edits/31.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-97dcdea10c3e468e9cdf494c164cb57b.44c007c6ef70de48c276f075634e0784 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/b9177219254176afda2736fa49738b3b/recovered.edits/31.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/cf/testContinuousSplitUsingLinkFile=ccfdcfcce076ae8d4eba487c11557fc3-4a0b2d1dba3d4a34abcc61a773d34aaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/bc9b2c67e807ae977718306095e413a2/recovered.edits/31.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-4a0b2d1dba3d4a34abcc61a773d34aaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-4a0b2d1dba3d4a34abcc61a773d34aaa/49eb6a8a2a32c73db4ac8361350664cb.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-4a0b2d1dba3d4a34abcc61a773d34aaa/bc9b2c67e807ae977718306095e413a2.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-51adb46ba2224c2980adab43d6be3499 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-51adb46ba2224c2980adab43d6be3499/49eb6a8a2a32c73db4ac8361350664cb.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-51adb46ba2224c2980adab43d6be3499/8052e7190810ff48a9fad1b880559c95.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-97dcdea10c3e468e9cdf494c164cb57b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/.links-97dcdea10c3e468e9cdf494c164cb57b/44c007c6ef70de48c276f075634e0784.testContinuousSplitUsingLinkFile hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/4a0b2d1dba3d4a34abcc61a773d34aaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/51adb46ba2224c2980adab43d6be3499 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/cf/97dcdea10c3e468e9cdf494c164cb57b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testContinuousSplitUsingLinkFile/ccfdcfcce076ae8d4eba487c11557fc3/recovered.edits/25.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/1a043584b185b695c44ad7c0f652836c/recovered.edits/11.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/96ec7655b4fa460c832befde88bf622a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/b1636f999510484da9a00512fd3a59f0 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/22be79dbd2c59d446651c6f009aeee63/recovered.edits/16.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/82cb42e3ff0b471d8325c8bf44538dd2 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/b7404d8a335947a3925c1032d6e0c57b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/info/dbf7c4b422fd4d22b7cd6ec2c30b6e54.1a043584b185b695c44ad7c0f652836c hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testMasterRestartAtRegionSplitPendingCatalogJanitor/8839cd6364743d0ae1f1090faca02423/recovered.edits/16.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/.links-8771ccf059bc4608b6fc484c5097c514 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/.links-8771ccf059bc4608b6fc484c5097c514/b15cc040ddc70423471a965482842fb6.testRITStateForRollback hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/cf/8771ccf059bc4608b6fc484c5097c514 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testRITStateForRollback/864e1811adec64ed8b346b0fa5959647/recovered.edits/14.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/4a65cf1049134edfb15bca1bd0ca4eaa hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/info/f51a873bfcd34fed826bf0fd7b9100c1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/0000000000000000012 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/383e6bcb64774cf6ef214b50782ac346/recovered.edits/13.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/14e83e6b39134f7c8ee3cc338dec97e4 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/46fcc7cc8626607b76b2955038597ba6/recovered.edits/19.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/4a65cf1049134edfb15bca1bd0ca4eaa.383e6bcb64774cf6ef214b50782ac346 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/info/89bbe1f4b18c43a19d882029ceb29096 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/613b8f43341489d942acf5814ba6a43b/recovered.edits/19.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/596f85c5213e4455b143cc37d3080084.ff13f8e1c63474defaefc7d45bc4b08a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/info/898b5951b57d41b3b5453c0c45df2556 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/d110326d2f5fcd1365b84bd9c1da91a4/recovered.edits/14.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/info/596f85c5213e4455b143cc37d3080084 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testShutdownFixupWhenDaughterHasSplit/ff13f8e1c63474defaefc7d45bc4b08a/recovered.edits/8.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/2cbeb3f513534543878f017c83520c26 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/58ff9798160037433aff3914405d3ea1/recovered.edits/23.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/2599a0deabee4da8a1aa887f0bee2810 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/cf/bb1b05c500ac4d9ea0ede28f12cbb01e hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/b7a313a1fe91c1be479ca52dccffaed5/recovered.edits/19.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/2599a0deabee4da8a1aa887f0bee2810.b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/9e135334a6af4c75b9715bc7bd0aca23 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/cf/bb1b05c500ac4d9ea0ede28f12cbb01e.b7a313a1fe91c1be479ca52dccffaed5 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitFailedCompactionAndSplit/f2a2d598705454a709d7057c7f772c3a/recovered.edits/23.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/info/a8001c77281946268bba24e3bdea3d67 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/061de5890a7693cc420bc7361ec15023/recovered.edits/15.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/1b92f430ddfc472ebc7a0b83637fe044.a4240b09888f2c679a6d53d3ba64e5d8 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/info/88c0a87656904167b14b2df2f6130877 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/83fe1258a020c8284afa89fd80ada9be/recovered.edits/15.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/info/1b92f430ddfc472ebc7a0b83637fe044 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRollbackOnRegionClosing/a4240b09888f2c679a6d53d3ba64e5d8/recovered.edits/11.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/col/70acab94f6e84a28ba917c73dc325c12 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/3a1940ecd93b7c6a3b196c97cadecbb6/recovered.edits/63.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/63a09604fe7343d69e9fa7bc7654ad80.d5e64bf2fd2e5c458f152aa35d000fb1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/col/76f51ff2cc8f40128abf12210dbb5a16 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/9a6461924e1cac9cba18e02dc09c9189/recovered.edits/63.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/03a785c75f504434b0a4a8935ba4db56 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/25464e50e9fa41249a2adc6f11771828 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/43308d3e9e75477c8b7911ffffe6a993 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/479e3ad5bee6454597090224a4832898 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/63a09604fe7343d69e9fa7bc7654ad80 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/82077d9e77be4aa9a3936de33fca5b85 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/8bd255be04e549da827960e877aeb20f hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ace268f8c9604569a46924f822aee302 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/af5e63ac1bf7443da10d7570ed15c5ff hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/ba0d674e65644b9e81f477b9fc2ad703 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c167e1d44f0944e090551070463e26a7 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/c3f69e0b68e94f4bb3d4fe55791c839d hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/d897f49f751449c282dc723b35f3748e hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/col/e4f5758207d34fae83be9bec50400aee hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitShouldNotThrowNPEEvenARegionHasEmptySplitFiles/d5e64bf2fd2e5c458f152aa35d000fb1/recovered.edits/59.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/f/f16736fb656943859665ea2817773bb6 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/i_f/ba572f8d4db74a35a7f498c3d96ca27b hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testStoreFileReferenceCreationWhenSplitPolicySaysToSkipRangeCheck/fece31c14c6aaa1af9eb8ab1ce6d3cd8/recovered.edits/13.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/corrupt hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/.tabledesc hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/.tabledesc/.tableinfo.0000000001 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/.tmp hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/recovered.edits/4.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/recovered.edits/4.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/.splits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits/4.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/.tabledesc hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/.tmp hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/recovered.edits/1.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/rep_barrier hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/table hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/.tabledesc hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/.tmp hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/.regioninfo hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/info hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/recovered.edits hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/recovered.edits/1.seqid hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/hbase.id hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/hbase.version hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/mobdir hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs/jenkins-hbase9.apache.org%2C41081%2C1689101231767.1689101233268 hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/staging 2023-07-11 18:47:51,634 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:51,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=true 2023-07-11 18:47:51,636 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(174): Tear down, remove table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:51,637 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testSplitRegionWithNoStoreFiles 2023-07-11 18:47:51,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testSplitRegionWithNoStoreFiles 2023-07-11 18:47:51,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=178, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:51,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=178 2023-07-11 18:47:51,640 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitRegionWithNoStoreFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101271640"}]},"ts":"1689101271640"} 2023-07-11 18:47:51,642 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testSplitRegionWithNoStoreFiles, state=DISABLING in hbase:meta 2023-07-11 18:47:51,643 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testSplitRegionWithNoStoreFiles to state=DISABLING 2023-07-11 18:47:51,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=179, ppid=178, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=a8e19ae84d21b1873bb824f123014179, UNASSIGN}, {pid=180, ppid=178, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ea870051f419fd438db2b9d65c6d3296, UNASSIGN}] 2023-07-11 18:47:51,645 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=179, ppid=178, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=a8e19ae84d21b1873bb824f123014179, UNASSIGN 2023-07-11 18:47:51,646 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=180, ppid=178, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ea870051f419fd438db2b9d65c6d3296, UNASSIGN 2023-07-11 18:47:51,646 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=179 updating hbase:meta row=a8e19ae84d21b1873bb824f123014179, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:51,646 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=180 updating hbase:meta row=ea870051f419fd438db2b9d65c6d3296, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:51,646 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101271646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101271646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101271646"}]},"ts":"1689101271646"} 2023-07-11 18:47:51,646 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101271646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101271646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101271646"}]},"ts":"1689101271646"} 2023-07-11 18:47:51,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=181, ppid=179, state=RUNNABLE; CloseRegionProcedure a8e19ae84d21b1873bb824f123014179, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:51,648 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=182, ppid=180, state=RUNNABLE; CloseRegionProcedure ea870051f419fd438db2b9d65c6d3296, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:51,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=178 2023-07-11 18:47:51,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a8e19ae84d21b1873bb824f123014179, disabling compactions & flushes 2023-07-11 18:47:51,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179. 2023-07-11 18:47:51,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179. 2023-07-11 18:47:51,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179. after waiting 0 ms 2023-07-11 18:47:51,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179. 2023-07-11 18:47:51,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:47:51,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179. 2023-07-11 18:47:51,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a8e19ae84d21b1873bb824f123014179: 2023-07-11 18:47:51,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:51,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ea870051f419fd438db2b9d65c6d3296, disabling compactions & flushes 2023-07-11 18:47:51,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296. 2023-07-11 18:47:51,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296. 2023-07-11 18:47:51,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296. after waiting 0 ms 2023-07-11 18:47:51,808 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=179 updating hbase:meta row=a8e19ae84d21b1873bb824f123014179, regionState=CLOSED 2023-07-11 18:47:51,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296. 2023-07-11 18:47:51,808 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101271808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101271808"}]},"ts":"1689101271808"} 2023-07-11 18:47:51,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=181, resume processing ppid=179 2023-07-11 18:47:51,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=181, ppid=179, state=SUCCESS; CloseRegionProcedure a8e19ae84d21b1873bb824f123014179, server=jenkins-hbase9.apache.org,40505,1689101231800 in 161 msec 2023-07-11 18:47:51,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/recovered.edits/7.seqid, newMaxSeqId=7, maxSeqId=4 2023-07-11 18:47:51,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296. 2023-07-11 18:47:51,811 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=179, ppid=178, state=SUCCESS; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=a8e19ae84d21b1873bb824f123014179, UNASSIGN in 167 msec 2023-07-11 18:47:51,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ea870051f419fd438db2b9d65c6d3296: 2023-07-11 18:47:51,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:51,813 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=180 updating hbase:meta row=ea870051f419fd438db2b9d65c6d3296, regionState=CLOSED 2023-07-11 18:47:51,970 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1689101271813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101271813"}]},"ts":"1689101271813"} 2023-07-11 18:47:51,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=178 2023-07-11 18:47:51,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=182, resume processing ppid=180 2023-07-11 18:47:51,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=182, ppid=180, state=SUCCESS; CloseRegionProcedure ea870051f419fd438db2b9d65c6d3296, server=jenkins-hbase9.apache.org,40505,1689101231800 in 324 msec 2023-07-11 18:47:51,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=180, resume processing ppid=178 2023-07-11 18:47:51,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=180, ppid=178, state=SUCCESS; TransitRegionStateProcedure table=testSplitRegionWithNoStoreFiles, region=ea870051f419fd438db2b9d65c6d3296, UNASSIGN in 330 msec 2023-07-11 18:47:51,976 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitRegionWithNoStoreFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101271976"}]},"ts":"1689101271976"} 2023-07-11 18:47:51,977 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testSplitRegionWithNoStoreFiles, state=DISABLED in hbase:meta 2023-07-11 18:47:51,979 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testSplitRegionWithNoStoreFiles to state=DISABLED 2023-07-11 18:47:51,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=178, state=SUCCESS; DisableTableProcedure table=testSplitRegionWithNoStoreFiles in 343 msec 2023-07-11 18:47:52,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=178 2023-07-11 18:47:52,273 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testSplitRegionWithNoStoreFiles, procId: 178 completed 2023-07-11 18:47:52,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testSplitRegionWithNoStoreFiles 2023-07-11 18:47:52,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=183, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:52,276 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=183, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:52,276 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=183, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:52,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=183 2023-07-11 18:47:52,281 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:52,281 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:52,281 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:52,283 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/recovered.edits] 2023-07-11 18:47:52,283 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/recovered.edits] 2023-07-11 18:47:52,284 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/info, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits] 2023-07-11 18:47:52,289 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/recovered.edits/7.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179/recovered.edits/7.seqid 2023-07-11 18:47:52,289 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/recovered.edits/7.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296/recovered.edits/7.seqid 2023-07-11 18:47:52,289 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits/4.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f/recovered.edits/4.seqid 2023-07-11 18:47:52,289 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/a8e19ae84d21b1873bb824f123014179 2023-07-11 18:47:52,289 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ea870051f419fd438db2b9d65c6d3296 2023-07-11 18:47:52,289 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitRegionWithNoStoreFiles/ec8272f528aea999d0996151be5adb6f 2023-07-11 18:47:52,290 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testSplitRegionWithNoStoreFiles regions 2023-07-11 18:47:52,291 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=183, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:52,293 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testSplitRegionWithNoStoreFiles from hbase:meta 2023-07-11 18:47:52,295 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testSplitRegionWithNoStoreFiles' descriptor. 2023-07-11 18:47:52,295 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=183, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:52,295 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testSplitRegionWithNoStoreFiles' from region states. 2023-07-11 18:47:52,296 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101272296"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:52,296 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101272296"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:52,296 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101272296"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:52,297 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-11 18:47:52,297 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ec8272f528aea999d0996151be5adb6f, NAME => 'testSplitRegionWithNoStoreFiles,,1689101269830.ec8272f528aea999d0996151be5adb6f.', STARTKEY => '', ENDKEY => ''}, {ENCODED => a8e19ae84d21b1873bb824f123014179, NAME => 'testSplitRegionWithNoStoreFiles,,1689101270664.a8e19ae84d21b1873bb824f123014179.', STARTKEY => '', ENDKEY => 'row2'}, {ENCODED => ea870051f419fd438db2b9d65c6d3296, NAME => 'testSplitRegionWithNoStoreFiles,row2,1689101270664.ea870051f419fd438db2b9d65c6d3296.', STARTKEY => 'row2', ENDKEY => ''}] 2023-07-11 18:47:52,297 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testSplitRegionWithNoStoreFiles' as deleted. 2023-07-11 18:47:52,297 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitRegionWithNoStoreFiles","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101272297"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:52,298 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testSplitRegionWithNoStoreFiles state from META 2023-07-11 18:47:52,300 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=183, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testSplitRegionWithNoStoreFiles 2023-07-11 18:47:52,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=183, state=SUCCESS; DeleteTableProcedure table=testSplitRegionWithNoStoreFiles in 26 msec 2023-07-11 18:47:52,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=183 2023-07-11 18:47:52,378 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testSplitRegionWithNoStoreFiles, procId: 183 completed 2023-07-11 18:47:52,393 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testSplitRegionWithNoStoreFiles Thread=428 (was 431), OpenFileDescriptor=752 (was 750) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 204), ProcessCount=170 (was 170), AvailableMemoryMB=7588 (was 7652) 2023-07-11 18:47:52,407 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testSplitCompactWithPriority Thread=428, OpenFileDescriptor=752, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=170, AvailableMemoryMB=7587 2023-07-11 18:47:52,408 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:52,408 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:52,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testSplitCompactWithPriority', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:52,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=184, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSplitCompactWithPriority 2023-07-11 18:47:52,412 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=184, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testSplitCompactWithPriority execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:52,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testSplitCompactWithPriority" procId is: 184 2023-07-11 18:47:52,412 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=184, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testSplitCompactWithPriority execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:52,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=184 2023-07-11 18:47:52,414 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,414 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608 empty. 2023-07-11 18:47:52,415 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,415 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testSplitCompactWithPriority regions 2023-07-11 18:47:52,425 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:52,426 INFO [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1d2ef9ec9d45e1f32fcc1aef658a2608, NAME => 'testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testSplitCompactWithPriority', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:52,434 DEBUG [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(866): Instantiated testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:52,434 DEBUG [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(1604): Closing 1d2ef9ec9d45e1f32fcc1aef658a2608, disabling compactions & flushes 2023-07-11 18:47:52,434 INFO [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(1626): Closing region testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:52,434 DEBUG [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:52,434 DEBUG [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(1714): Acquired close lock on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. after waiting 0 ms 2023-07-11 18:47:52,434 DEBUG [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(1724): Updates disabled for region testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:52,434 INFO [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(1838): Closed testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:52,434 DEBUG [RegionOpenAndInit-testSplitCompactWithPriority-pool-0] regionserver.HRegion(1558): Region close journal for 1d2ef9ec9d45e1f32fcc1aef658a2608: 2023-07-11 18:47:52,436 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=184, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testSplitCompactWithPriority execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:52,436 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689101272436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101272436"}]},"ts":"1689101272436"} 2023-07-11 18:47:52,438 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:52,438 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=184, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testSplitCompactWithPriority execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:52,438 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitCompactWithPriority","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101272438"}]},"ts":"1689101272438"} 2023-07-11 18:47:52,439 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testSplitCompactWithPriority, state=ENABLING in hbase:meta 2023-07-11 18:47:52,445 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:52,446 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:52,446 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:52,446 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:52,446 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 18:47:52,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=185, ppid=184, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1d2ef9ec9d45e1f32fcc1aef658a2608, ASSIGN}] 2023-07-11 18:47:52,447 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=185, ppid=184, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1d2ef9ec9d45e1f32fcc1aef658a2608, ASSIGN 2023-07-11 18:47:52,448 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=185, ppid=184, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1d2ef9ec9d45e1f32fcc1aef658a2608, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33849,1689101240752; forceNewPlan=false, retain=false 2023-07-11 18:47:52,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=184 2023-07-11 18:47:52,598 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 18:47:52,599 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=185 updating hbase:meta row=1d2ef9ec9d45e1f32fcc1aef658a2608, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:52,600 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689101272599"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101272599"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101272599"}]},"ts":"1689101272599"} 2023-07-11 18:47:52,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=186, ppid=185, state=RUNNABLE; OpenRegionProcedure 1d2ef9ec9d45e1f32fcc1aef658a2608, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:52,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=184 2023-07-11 18:47:52,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:52,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1d2ef9ec9d45e1f32fcc1aef658a2608, NAME => 'testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:52,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitCompactWithPriority 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:52,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,757 INFO [StoreOpener-1d2ef9ec9d45e1f32fcc1aef658a2608-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,759 DEBUG [StoreOpener-1d2ef9ec9d45e1f32fcc1aef658a2608-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf 2023-07-11 18:47:52,759 DEBUG [StoreOpener-1d2ef9ec9d45e1f32fcc1aef658a2608-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf 2023-07-11 18:47:52,759 INFO [StoreOpener-1d2ef9ec9d45e1f32fcc1aef658a2608-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d2ef9ec9d45e1f32fcc1aef658a2608 columnFamilyName cf 2023-07-11 18:47:52,759 INFO [StoreOpener-1d2ef9ec9d45e1f32fcc1aef658a2608-1] regionserver.HStore(310): Store=1d2ef9ec9d45e1f32fcc1aef658a2608/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:52,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:52,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:52,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1d2ef9ec9d45e1f32fcc1aef658a2608; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66295785, jitterRate=-0.012115821242332458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:52,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1d2ef9ec9d45e1f32fcc1aef658a2608: 2023-07-11 18:47:52,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608., pid=186, masterSystemTime=1689101272752 2023-07-11 18:47:52,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:52,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:52,766 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=185 updating hbase:meta row=1d2ef9ec9d45e1f32fcc1aef658a2608, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:52,766 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689101272766"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101272766"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101272766"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101272766"}]},"ts":"1689101272766"} 2023-07-11 18:47:52,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=186, resume processing ppid=185 2023-07-11 18:47:52,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=186, ppid=185, state=SUCCESS; OpenRegionProcedure 1d2ef9ec9d45e1f32fcc1aef658a2608, server=jenkins-hbase9.apache.org,33849,1689101240752 in 167 msec 2023-07-11 18:47:52,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=185, resume processing ppid=184 2023-07-11 18:47:52,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=185, ppid=184, state=SUCCESS; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1d2ef9ec9d45e1f32fcc1aef658a2608, ASSIGN in 323 msec 2023-07-11 18:47:52,771 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=184, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testSplitCompactWithPriority execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:52,771 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitCompactWithPriority","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101272771"}]},"ts":"1689101272771"} 2023-07-11 18:47:52,772 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testSplitCompactWithPriority, state=ENABLED in hbase:meta 2023-07-11 18:47:52,774 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=184, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testSplitCompactWithPriority execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:52,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=184, state=SUCCESS; CreateTableProcedure table=testSplitCompactWithPriority in 364 msec 2023-07-11 18:47:53,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=184 2023-07-11 18:47:53,016 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testSplitCompactWithPriority, procId: 184 completed 2023-07-11 18:47:53,017 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [10,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:53,019 DEBUG [Listener at localhost/44535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 18:47:53,021 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 18:47:53,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:53,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(165): Submitting procedure testSplitCompactWithPriority 2023-07-11 18:47:53,029 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitCompactWithPriority' 2023-07-11 18:47:53,029 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,029 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitCompactWithPriority' starting 'acquire' 2023-07-11 18:47:53,029 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitCompactWithPriority', kicking off acquire phase on members. 2023-07-11 18:47:53,029 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,029 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,031 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,031 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,031 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,031 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,031 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,031 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,033 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,032 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,033 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,033 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,033 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:53,033 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:53,033 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,033 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. started... 2023-07-11 18:47:53,034 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d2ef9ec9d45e1f32fcc1aef658a2608 1/1 column families, dataSize=116 B heapSize=672 B 2023-07-11 18:47:53,035 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,035 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,035 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,036 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,035 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,036 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,044 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/.tmp/cf/3282d3fe613544fa84c1c8ddbefedfda 2023-07-11 18:47:53,049 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/.tmp/cf/3282d3fe613544fa84c1c8ddbefedfda as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/3282d3fe613544fa84c1c8ddbefedfda 2023-07-11 18:47:53,052 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/3282d3fe613544fa84c1c8ddbefedfda, entries=4, sequenceid=8, filesize=4.8 K 2023-07-11 18:47:53,053 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~116 B/116, heapSize ~656 B/656, currentSize=0 B/0 for 1d2ef9ec9d45e1f32fcc1aef658a2608 in 19ms, sequenceid=8, compaction requested=false 2023-07-11 18:47:53,053 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testSplitCompactWithPriority' 2023-07-11 18:47:53,054 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d2ef9ec9d45e1f32fcc1aef658a2608: 2023-07-11 18:47:53,054 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,054 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:53,054 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:53,054 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,054 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,054 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,057 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,057 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,057 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,057 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure 'testSplitCompactWithPriority' on coordinator 2023-07-11 18:47:53,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35f4d8b5[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:53,059 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitCompactWithPriority' starting 'in-barrier' execution. 2023-07-11 18:47:53,059 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,060 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,060 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,060 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,060 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,060 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,060 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:53,060 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,061 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:53,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,061 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,061 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,061 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,061 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,061 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:53,061 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:53,062 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,062 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,062 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,063 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,063 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,063 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,065 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,065 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,065 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,065 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitCompactWithPriority' member 'jenkins-hbase9.apache.org,33849,1689101240752': 2023-07-11 18:47:53,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' released barrier for procedure'testSplitCompactWithPriority', counting down latch. Waiting for 0 more 2023-07-11 18:47:53,068 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitCompactWithPriority' execution completed 2023-07-11 18:47:53,068 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:53,068 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:53,068 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitCompactWithPriority 2023-07-11 18:47:53,068 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitCompactWithPriorityincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:53,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,070 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,071 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,071 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,073 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,073 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,073 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,076 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,076 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,076 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,076 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,076 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,076 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,076 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,076 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,076 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitCompactWithPriority' 2023-07-11 18:47:53,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:53,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitCompactWithPriority'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:53,077 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:53,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,177 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:53,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:53,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:53,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(143): Procedure testSplitCompactWithPriority was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:53,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(165): Submitting procedure testSplitCompactWithPriority 2023-07-11 18:47:53,187 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitCompactWithPriority' 2023-07-11 18:47:53,187 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,187 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitCompactWithPriority' starting 'acquire' 2023-07-11 18:47:53,187 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitCompactWithPriority', kicking off acquire phase on members. 2023-07-11 18:47:53,188 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,188 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,189 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,189 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,190 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,190 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,191 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,190 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,191 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitCompactWithPriority is still present, removing 2023-07-11 18:47:53,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,191 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitCompactWithPriority is still present, removing 2023-07-11 18:47:53,191 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitCompactWithPriority is still present, removing 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,191 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,192 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:53,192 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:53,192 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,192 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. started... 2023-07-11 18:47:53,192 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d2ef9ec9d45e1f32fcc1aef658a2608 1/1 column families, dataSize=120 B heapSize=672 B 2023-07-11 18:47:53,194 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,195 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,195 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,195 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,195 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,195 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,204 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=120 B at sequenceid=15 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/.tmp/cf/1aab0297edfc4933911ed9ae41dae63b 2023-07-11 18:47:53,210 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/.tmp/cf/1aab0297edfc4933911ed9ae41dae63b as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/1aab0297edfc4933911ed9ae41dae63b 2023-07-11 18:47:53,219 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/1aab0297edfc4933911ed9ae41dae63b, entries=4, sequenceid=15, filesize=4.9 K 2023-07-11 18:47:53,219 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~120 B/120, heapSize ~656 B/656, currentSize=0 B/0 for 1d2ef9ec9d45e1f32fcc1aef658a2608 in 27ms, sequenceid=15, compaction requested=false 2023-07-11 18:47:53,220 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d2ef9ec9d45e1f32fcc1aef658a2608: 2023-07-11 18:47:53,220 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,220 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:53,220 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:53,220 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,220 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,220 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,222 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,222 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,222 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,222 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure 'testSplitCompactWithPriority' on coordinator 2023-07-11 18:47:53,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eec867f[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:53,224 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitCompactWithPriority' starting 'in-barrier' execution. 2023-07-11 18:47:53,224 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,226 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,226 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:53,229 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,229 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,229 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,229 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,232 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,232 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,232 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,233 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,233 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,233 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitCompactWithPriority' member 'jenkins-hbase9.apache.org,33849,1689101240752': 2023-07-11 18:47:53,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' released barrier for procedure'testSplitCompactWithPriority', counting down latch. Waiting for 0 more 2023-07-11 18:47:53,235 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitCompactWithPriority' execution completed 2023-07-11 18:47:53,236 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:53,236 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:53,236 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitCompactWithPriority 2023-07-11 18:47:53,236 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitCompactWithPriorityincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:53,238 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,238 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,238 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,239 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,239 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,240 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,241 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,242 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,242 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,244 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitCompactWithPriority' 2023-07-11 18:47:53,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:53,245 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,245 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitCompactWithPriority'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:53,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,246 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,246 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,246 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,246 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:53,246 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,346 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:53,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:53,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:53,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(143): Procedure testSplitCompactWithPriority was in running list but was completed. Accepting new attempt. 2023-07-11 18:47:53,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(165): Submitting procedure testSplitCompactWithPriority 2023-07-11 18:47:53,356 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitCompactWithPriority' 2023-07-11 18:47:53,356 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,356 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitCompactWithPriority' starting 'acquire' 2023-07-11 18:47:53,356 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitCompactWithPriority', kicking off acquire phase on members. 2023-07-11 18:47:53,357 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,357 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,358 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,358 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,358 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,358 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,359 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,359 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitCompactWithPriority 2023-07-11 18:47:53,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitCompactWithPriority is still present, removing 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitCompactWithPriority is still present, removing 2023-07-11 18:47:53,360 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,360 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testSplitCompactWithPriority is still present, removing 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitCompactWithPriority 2023-07-11 18:47:53,360 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,360 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,360 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,360 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitCompactWithPriority' with timeout 60000ms 2023-07-11 18:47:53,361 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:53,361 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,361 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitCompactWithPriority' starting 'acquire' stage 2023-07-11 18:47:53,360 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,361 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,361 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,361 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,361 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:53,361 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:53,361 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,361 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. started... 2023-07-11 18:47:53,361 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1d2ef9ec9d45e1f32fcc1aef658a2608 1/1 column families, dataSize=120 B heapSize=672 B 2023-07-11 18:47:53,362 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,364 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,364 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,364 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,365 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,365 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,377 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=120 B at sequenceid=22 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/.tmp/cf/afa4e12b5dfb4fc690dad56ec1c18765 2023-07-11 18:47:53,382 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/.tmp/cf/afa4e12b5dfb4fc690dad56ec1c18765 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/afa4e12b5dfb4fc690dad56ec1c18765 2023-07-11 18:47:53,386 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/afa4e12b5dfb4fc690dad56ec1c18765, entries=4, sequenceid=22, filesize=4.9 K 2023-07-11 18:47:53,387 INFO [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~120 B/120, heapSize ~656 B/656, currentSize=0 B/0 for 1d2ef9ec9d45e1f32fcc1aef658a2608 in 26ms, sequenceid=22, compaction requested=true 2023-07-11 18:47:53,387 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1d2ef9ec9d45e1f32fcc1aef658a2608: 2023-07-11 18:47:53,387 DEBUG [rs(jenkins-hbase9.apache.org,33849,1689101240752)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,387 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:53,387 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:53,387 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,387 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitCompactWithPriority' locally acquired 2023-07-11 18:47:53,387 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitCompactWithPriority) in zk 2023-07-11 18:47:53,389 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,389 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,389 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,389 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitCompactWithPriority' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure 'testSplitCompactWithPriority' on coordinator 2023-07-11 18:47:53,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48b6e8e[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:53,391 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitCompactWithPriority' starting 'in-barrier' execution. 2023-07-11 18:47:53,391 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,392 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,392 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,392 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,393 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,393 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitCompactWithPriority' received 'reached' from coordinator. 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitCompactWithPriority' locally completed 2023-07-11 18:47:53,393 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitCompactWithPriority' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:53,394 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,394 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,394 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,394 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,397 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,397 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitCompactWithPriority' has notified controller of completion 2023-07-11 18:47:53,397 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,397 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,397 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,397 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitCompactWithPriority' completed. 2023-07-11 18:47:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitCompactWithPriority' member 'jenkins-hbase9.apache.org,33849,1689101240752': 2023-07-11 18:47:53,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' released barrier for procedure'testSplitCompactWithPriority', counting down latch. Waiting for 0 more 2023-07-11 18:47:53,400 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitCompactWithPriority' execution completed 2023-07-11 18:47:53,400 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:53,400 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:53,400 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitCompactWithPriority 2023-07-11 18:47:53,400 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitCompactWithPriorityincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:53,401 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:53,401 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,401 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,401 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,401 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,401 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:53,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,402 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,402 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,402 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,403 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:53,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,404 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:53,404 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitCompactWithPriority 2023-07-11 18:47:53,405 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,409 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:53,410 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitCompactWithPriority 2023-07-11 18:47:53,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitCompactWithPriority' 2023-07-11 18:47:53,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:53,409 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,410 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:53,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:53,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,410 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:53,410 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitCompactWithPriority'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:53,410 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,410 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:53,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:53,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:53,410 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:53,411 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,411 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitCompactWithPriority 2023-07-11 18:47:53,411 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitCompactWithPriority 2023-07-11 18:47:53,511 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:53,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:53,512 DEBUG [Listener at localhost/44535] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-07-11 18:47:53,512 DEBUG [Listener at localhost/44535] regionserver.HStore(1912): 1d2ef9ec9d45e1f32fcc1aef658a2608/cf is initiating major compaction (all files) 2023-07-11 18:47:53,512 INFO [Listener at localhost/44535] master.HMaster$3(1981): Client=null/null split testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,513 DEBUG [Listener at localhost/44535] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,513 DEBUG [Listener at localhost/44535] procedure2.ProcedureExecutor(1029): Stored pid=187, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitCompactWithPriority, parent=1d2ef9ec9d45e1f32fcc1aef658a2608, daughterA=2832a423cab04e28bf5780d6f14e3b67, daughterB=1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:53,515 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=187, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitCompactWithPriority, parent=1d2ef9ec9d45e1f32fcc1aef658a2608, daughterA=2832a423cab04e28bf5780d6f14e3b67, daughterB=1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:53,515 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=187, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitCompactWithPriority, parent=1d2ef9ec9d45e1f32fcc1aef658a2608, daughterA=2832a423cab04e28bf5780d6f14e3b67, daughterB=1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:53,515 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=187, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitCompactWithPriority, parent=1d2ef9ec9d45e1f32fcc1aef658a2608, daughterA=2832a423cab04e28bf5780d6f14e3b67, daughterB=1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:53,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=188, ppid=187, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1d2ef9ec9d45e1f32fcc1aef658a2608, UNASSIGN}] 2023-07-11 18:47:53,519 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=188, ppid=187, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1d2ef9ec9d45e1f32fcc1aef658a2608, UNASSIGN 2023-07-11 18:47:53,519 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=188 updating hbase:meta row=1d2ef9ec9d45e1f32fcc1aef658a2608, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,519 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689101273519"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101273519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101273519"}]},"ts":"1689101273519"} 2023-07-11 18:47:53,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=189, ppid=188, state=RUNNABLE; CloseRegionProcedure 1d2ef9ec9d45e1f32fcc1aef658a2608, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:53,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1d2ef9ec9d45e1f32fcc1aef658a2608, disabling compactions & flushes 2023-07-11 18:47:53,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. after waiting 0 ms 2023-07-11 18:47:53,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=1 2023-07-11 18:47:53,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608. 2023-07-11 18:47:53,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1d2ef9ec9d45e1f32fcc1aef658a2608: 2023-07-11 18:47:53,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,678 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=188 updating hbase:meta row=1d2ef9ec9d45e1f32fcc1aef658a2608, regionState=CLOSED 2023-07-11 18:47:53,678 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689101273678"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101273678"}]},"ts":"1689101273678"} 2023-07-11 18:47:53,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=189, resume processing ppid=188 2023-07-11 18:47:53,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=189, ppid=188, state=SUCCESS; CloseRegionProcedure 1d2ef9ec9d45e1f32fcc1aef658a2608, server=jenkins-hbase9.apache.org,33849,1689101240752 in 159 msec 2023-07-11 18:47:53,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=188, resume processing ppid=187 2023-07-11 18:47:53,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=188, ppid=187, state=SUCCESS; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1d2ef9ec9d45e1f32fcc1aef658a2608, UNASSIGN in 164 msec 2023-07-11 18:47:53,688 INFO [PEWorker-2] assignment.SplitTableRegionProcedure(694): pid=187 splitting 3 storefiles, region=1d2ef9ec9d45e1f32fcc1aef658a2608, threads=3 2023-07-11 18:47:53,688 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=187 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/1aab0297edfc4933911ed9ae41dae63b for region: 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,688 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(776): pid=187 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/3282d3fe613544fa84c1c8ddbefedfda for region: 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,688 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(776): pid=187 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/afa4e12b5dfb4fc690dad56ec1c18765 for region: 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,692 DEBUG [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(713): Will create HFileLink file for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/1aab0297edfc4933911ed9ae41dae63b, top=false 2023-07-11 18:47:53,696 DEBUG [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(700): Will create HFileLink file for hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/afa4e12b5dfb4fc690dad56ec1c18765, top=true 2023-07-11 18:47:53,696 INFO [StoreFileSplitter-pool-0] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/.splits/2832a423cab04e28bf5780d6f14e3b67/cf/testSplitCompactWithPriority=1d2ef9ec9d45e1f32fcc1aef658a2608-1aab0297edfc4933911ed9ae41dae63b for child: 2832a423cab04e28bf5780d6f14e3b67, parent: 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,700 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=187 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/1aab0297edfc4933911ed9ae41dae63b for region: 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,704 INFO [StoreFileSplitter-pool-2] regionserver.HRegionFileSystem(742): Created linkFile:hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/.splits/1e974fc58d5881584f83b96e6a97fd7e/cf/testSplitCompactWithPriority=1d2ef9ec9d45e1f32fcc1aef658a2608-afa4e12b5dfb4fc690dad56ec1c18765 for child: 1e974fc58d5881584f83b96e6a97fd7e, parent: 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,704 DEBUG [StoreFileSplitter-pool-2] assignment.SplitTableRegionProcedure(787): pid=187 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/afa4e12b5dfb4fc690dad56ec1c18765 for region: 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,716 DEBUG [StoreFileSplitter-pool-1] assignment.SplitTableRegionProcedure(787): pid=187 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/3282d3fe613544fa84c1c8ddbefedfda for region: 1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:53,716 DEBUG [PEWorker-2] assignment.SplitTableRegionProcedure(755): pid=187 split storefiles for region 1d2ef9ec9d45e1f32fcc1aef658a2608 Daughter A: 2 storefiles, Daughter B: 2 storefiles. 2023-07-11 18:47:53,744 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=-1 2023-07-11 18:47:53,745 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/recovered.edits/25.seqid, newMaxSeqId=25, maxSeqId=-1 2023-07-11 18:47:53,746 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1689101273746"},{"qualifier":"splitA","vlen":66,"tag":[],"timestamp":"1689101273746"},{"qualifier":"splitB","vlen":66,"tag":[],"timestamp":"1689101273746"}]},"ts":"1689101273746"} 2023-07-11 18:47:53,747 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101273746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101273746"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101273746"}]},"ts":"1689101273746"} 2023-07-11 18:47:53,747 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101273746"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101273746"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101273746"}]},"ts":"1689101273746"} 2023-07-11 18:47:53,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=190, ppid=187, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=2832a423cab04e28bf5780d6f14e3b67, ASSIGN}, {pid=191, ppid=187, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1e974fc58d5881584f83b96e6a97fd7e, ASSIGN}] 2023-07-11 18:47:53,750 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=191, ppid=187, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1e974fc58d5881584f83b96e6a97fd7e, ASSIGN 2023-07-11 18:47:53,750 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=190, ppid=187, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=2832a423cab04e28bf5780d6f14e3b67, ASSIGN 2023-07-11 18:47:53,750 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=191, ppid=187, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1e974fc58d5881584f83b96e6a97fd7e, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,33849,1689101240752; forceNewPlan=false, retain=false 2023-07-11 18:47:53,750 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=190, ppid=187, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=2832a423cab04e28bf5780d6f14e3b67, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,33849,1689101240752; forceNewPlan=false, retain=false 2023-07-11 18:47:53,901 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:53,903 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=191 updating hbase:meta row=1e974fc58d5881584f83b96e6a97fd7e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,903 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=190 updating hbase:meta row=2832a423cab04e28bf5780d6f14e3b67, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:53,903 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101273903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101273903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101273903"}]},"ts":"1689101273903"} 2023-07-11 18:47:53,903 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101273903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101273903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101273903"}]},"ts":"1689101273903"} 2023-07-11 18:47:53,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=192, ppid=191, state=RUNNABLE; OpenRegionProcedure 1e974fc58d5881584f83b96e6a97fd7e, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:53,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=193, ppid=190, state=RUNNABLE; OpenRegionProcedure 2832a423cab04e28bf5780d6f14e3b67, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:53,951 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:47:54,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. 2023-07-11 18:47:54,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2832a423cab04e28bf5780d6f14e3b67, NAME => 'testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.', STARTKEY => '', ENDKEY => 'row4'} 2023-07-11 18:47:54,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitCompactWithPriority 2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:54,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:54,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:54,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:54,062 INFO [StoreOpener-2832a423cab04e28bf5780d6f14e3b67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:54,063 DEBUG [StoreOpener-2832a423cab04e28bf5780d6f14e3b67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf 2023-07-11 18:47:54,063 DEBUG [StoreOpener-2832a423cab04e28bf5780d6f14e3b67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf 2023-07-11 18:47:54,063 INFO [StoreOpener-2832a423cab04e28bf5780d6f14e3b67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2832a423cab04e28bf5780d6f14e3b67 columnFamilyName cf 2023-07-11 18:47:54,071 DEBUG [StoreOpener-2832a423cab04e28bf5780d6f14e3b67-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf/3282d3fe613544fa84c1c8ddbefedfda.1d2ef9ec9d45e1f32fcc1aef658a2608->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/3282d3fe613544fa84c1c8ddbefedfda-bottom 2023-07-11 18:47:54,074 DEBUG [StoreOpener-2832a423cab04e28bf5780d6f14e3b67-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf/testSplitCompactWithPriority=1d2ef9ec9d45e1f32fcc1aef658a2608-1aab0297edfc4933911ed9ae41dae63b 2023-07-11 18:47:54,075 INFO [StoreOpener-2832a423cab04e28bf5780d6f14e3b67-1] regionserver.HStore(310): Store=2832a423cab04e28bf5780d6f14e3b67/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:54,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:54,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:54,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:54,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2832a423cab04e28bf5780d6f14e3b67; next sequenceid=26; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73252012, jitterRate=0.09154003858566284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:54,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2832a423cab04e28bf5780d6f14e3b67: 2023-07-11 18:47:54,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67., pid=193, masterSystemTime=1689101274057 2023-07-11 18:47:54,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.,because compaction is disabled. 2023-07-11 18:47:54,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. 2023-07-11 18:47:54,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. 2023-07-11 18:47:54,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. 2023-07-11 18:47:54,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e974fc58d5881584f83b96e6a97fd7e, NAME => 'testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.', STARTKEY => 'row4', ENDKEY => ''} 2023-07-11 18:47:54,081 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=190 updating hbase:meta row=2832a423cab04e28bf5780d6f14e3b67, regionState=OPEN, openSeqNum=26, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:54,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitCompactWithPriority 1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:54,081 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101274081"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101274081"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101274081"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101274081"}]},"ts":"1689101274081"} 2023-07-11 18:47:54,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:54,083 INFO [StoreOpener-1e974fc58d5881584f83b96e6a97fd7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:54,083 DEBUG [StoreOpener-1e974fc58d5881584f83b96e6a97fd7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf 2023-07-11 18:47:54,084 DEBUG [StoreOpener-1e974fc58d5881584f83b96e6a97fd7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf 2023-07-11 18:47:54,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=193, resume processing ppid=190 2023-07-11 18:47:54,084 INFO [StoreOpener-1e974fc58d5881584f83b96e6a97fd7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e974fc58d5881584f83b96e6a97fd7e columnFamilyName cf 2023-07-11 18:47:54,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=193, ppid=190, state=SUCCESS; OpenRegionProcedure 2832a423cab04e28bf5780d6f14e3b67, server=jenkins-hbase9.apache.org,33849,1689101240752 in 179 msec 2023-07-11 18:47:54,085 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=190, ppid=187, state=SUCCESS; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=2832a423cab04e28bf5780d6f14e3b67, ASSIGN in 335 msec 2023-07-11 18:47:54,090 DEBUG [StoreOpener-1e974fc58d5881584f83b96e6a97fd7e-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf/3282d3fe613544fa84c1c8ddbefedfda.1d2ef9ec9d45e1f32fcc1aef658a2608->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/3282d3fe613544fa84c1c8ddbefedfda-top 2023-07-11 18:47:54,093 DEBUG [StoreOpener-1e974fc58d5881584f83b96e6a97fd7e-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf/testSplitCompactWithPriority=1d2ef9ec9d45e1f32fcc1aef658a2608-afa4e12b5dfb4fc690dad56ec1c18765 2023-07-11 18:47:54,093 INFO [StoreOpener-1e974fc58d5881584f83b96e6a97fd7e-1] regionserver.HStore(310): Store=1e974fc58d5881584f83b96e6a97fd7e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:54,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:54,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:54,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:54,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1e974fc58d5881584f83b96e6a97fd7e; next sequenceid=26; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75299809, jitterRate=0.12205459177494049}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 18:47:54,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1e974fc58d5881584f83b96e6a97fd7e: 2023-07-11 18:47:54,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e., pid=192, masterSystemTime=1689101274057 2023-07-11 18:47:54,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.,because compaction is disabled. 2023-07-11 18:47:54,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. 2023-07-11 18:47:54,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. 2023-07-11 18:47:54,099 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=191 updating hbase:meta row=1e974fc58d5881584f83b96e6a97fd7e, regionState=OPEN, openSeqNum=26, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:54,100 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101274099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101274099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101274099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101274099"}]},"ts":"1689101274099"} 2023-07-11 18:47:54,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=192, resume processing ppid=191 2023-07-11 18:47:54,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=192, ppid=191, state=SUCCESS; OpenRegionProcedure 1e974fc58d5881584f83b96e6a97fd7e, server=jenkins-hbase9.apache.org,33849,1689101240752 in 196 msec 2023-07-11 18:47:54,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=191, resume processing ppid=187 2023-07-11 18:47:54,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=191, ppid=187, state=SUCCESS; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1e974fc58d5881584f83b96e6a97fd7e, ASSIGN in 353 msec 2023-07-11 18:47:54,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=187, state=SUCCESS; SplitTableRegionProcedure table=testSplitCompactWithPriority, parent=1d2ef9ec9d45e1f32fcc1aef658a2608, daughterA=2832a423cab04e28bf5780d6f14e3b67, daughterB=1e974fc58d5881584f83b96e6a97fd7e in 590 msec 2023-07-11 18:47:57,264 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [3,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:57,704 DEBUG [Listener at localhost/44535] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-11 18:47:57,704 INFO [Listener at localhost/44535] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147482648 for CF cf since it belongs to recently split daughter region testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. 2023-07-11 18:47:57,704 DEBUG [Listener at localhost/44535] regionserver.HStore(1912): 2832a423cab04e28bf5780d6f14e3b67/cf is initiating major compaction (all files) 2023-07-11 18:47:57,705 DEBUG [Listener at localhost/44535] compactions.SortedCompactionPolicy(75): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 16 blocking 2023-07-11 18:47:57,705 INFO [Listener at localhost/44535] regionserver.HStore(1898): Keeping/Overriding Compaction request priority to -2147483638 for CF cf since it belongs to recently split daughter region testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. 2023-07-11 18:47:57,705 DEBUG [Listener at localhost/44535] regionserver.HStore(1912): 1e974fc58d5881584f83b96e6a97fd7e/cf is initiating major compaction (all files) 2023-07-11 18:47:57,706 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testSplitCompactWithPriority 2023-07-11 18:47:57,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testSplitCompactWithPriority 2023-07-11 18:47:57,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=194, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSplitCompactWithPriority 2023-07-11 18:47:57,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=194 2023-07-11 18:47:57,709 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitCompactWithPriority","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101277709"}]},"ts":"1689101277709"} 2023-07-11 18:47:57,710 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitCompactWithPriority, state=DISABLING in hbase:meta 2023-07-11 18:47:57,711 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testSplitCompactWithPriority to state=DISABLING 2023-07-11 18:47:57,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=195, ppid=194, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=2832a423cab04e28bf5780d6f14e3b67, UNASSIGN}, {pid=196, ppid=194, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1e974fc58d5881584f83b96e6a97fd7e, UNASSIGN}] 2023-07-11 18:47:57,712 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=195, ppid=194, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=2832a423cab04e28bf5780d6f14e3b67, UNASSIGN 2023-07-11 18:47:57,713 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=196, ppid=194, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1e974fc58d5881584f83b96e6a97fd7e, UNASSIGN 2023-07-11 18:47:57,713 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=195 updating hbase:meta row=2832a423cab04e28bf5780d6f14e3b67, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:57,713 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101277713"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101277713"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101277713"}]},"ts":"1689101277713"} 2023-07-11 18:47:57,714 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=196 updating hbase:meta row=1e974fc58d5881584f83b96e6a97fd7e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:57,714 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101277714"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101277714"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101277714"}]},"ts":"1689101277714"} 2023-07-11 18:47:57,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=197, ppid=195, state=RUNNABLE; CloseRegionProcedure 2832a423cab04e28bf5780d6f14e3b67, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:57,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=198, ppid=196, state=RUNNABLE; CloseRegionProcedure 1e974fc58d5881584f83b96e6a97fd7e, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:57,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=194 2023-07-11 18:47:57,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:57,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2832a423cab04e28bf5780d6f14e3b67, disabling compactions & flushes 2023-07-11 18:47:57,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. 2023-07-11 18:47:57,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. 2023-07-11 18:47:57,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. after waiting 0 ms 2023-07-11 18:47:57,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. 2023-07-11 18:47:57,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=25 2023-07-11 18:47:57,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67. 2023-07-11 18:47:57,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2832a423cab04e28bf5780d6f14e3b67: 2023-07-11 18:47:57,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:57,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:57,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1e974fc58d5881584f83b96e6a97fd7e, disabling compactions & flushes 2023-07-11 18:47:57,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. 2023-07-11 18:47:57,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. 2023-07-11 18:47:57,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. after waiting 0 ms 2023-07-11 18:47:57,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. 2023-07-11 18:47:57,872 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=195 updating hbase:meta row=2832a423cab04e28bf5780d6f14e3b67, regionState=CLOSED 2023-07-11 18:47:57,872 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101277872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101277872"}]},"ts":"1689101277872"} 2023-07-11 18:47:57,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=197, resume processing ppid=195 2023-07-11 18:47:57,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=197, ppid=195, state=SUCCESS; CloseRegionProcedure 2832a423cab04e28bf5780d6f14e3b67, server=jenkins-hbase9.apache.org,33849,1689101240752 in 159 msec 2023-07-11 18:47:57,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=195, ppid=194, state=SUCCESS; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=2832a423cab04e28bf5780d6f14e3b67, UNASSIGN in 163 msec 2023-07-11 18:47:57,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/recovered.edits/28.seqid, newMaxSeqId=28, maxSeqId=25 2023-07-11 18:47:57,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e. 2023-07-11 18:47:57,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1e974fc58d5881584f83b96e6a97fd7e: 2023-07-11 18:47:57,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:57,877 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=196 updating hbase:meta row=1e974fc58d5881584f83b96e6a97fd7e, regionState=CLOSED 2023-07-11 18:47:57,877 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689101277877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101277877"}]},"ts":"1689101277877"} 2023-07-11 18:47:57,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=198, resume processing ppid=196 2023-07-11 18:47:57,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=198, ppid=196, state=SUCCESS; CloseRegionProcedure 1e974fc58d5881584f83b96e6a97fd7e, server=jenkins-hbase9.apache.org,33849,1689101240752 in 163 msec 2023-07-11 18:47:57,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=196, resume processing ppid=194 2023-07-11 18:47:57,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=196, ppid=194, state=SUCCESS; TransitRegionStateProcedure table=testSplitCompactWithPriority, region=1e974fc58d5881584f83b96e6a97fd7e, UNASSIGN in 167 msec 2023-07-11 18:47:57,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitCompactWithPriority","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101277881"}]},"ts":"1689101277881"} 2023-07-11 18:47:57,881 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testSplitCompactWithPriority, state=DISABLED in hbase:meta 2023-07-11 18:47:57,883 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testSplitCompactWithPriority to state=DISABLED 2023-07-11 18:47:57,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=194, state=SUCCESS; DisableTableProcedure table=testSplitCompactWithPriority in 177 msec 2023-07-11 18:47:58,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=194 2023-07-11 18:47:58,011 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testSplitCompactWithPriority, procId: 194 completed 2023-07-11 18:47:58,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testSplitCompactWithPriority 2023-07-11 18:47:58,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=199, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSplitCompactWithPriority 2023-07-11 18:47:58,014 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=199, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testSplitCompactWithPriority 2023-07-11 18:47:58,015 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=199, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testSplitCompactWithPriority 2023-07-11 18:47:58,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=199 2023-07-11 18:47:58,019 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:58,019 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:58,019 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:58,021 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/recovered.edits] 2023-07-11 18:47:58,021 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/recovered.edits] 2023-07-11 18:47:58,021 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/recovered.edits] 2023-07-11 18:47:58,024 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/1aab0297edfc4933911ed9ae41dae63b to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/1aab0297edfc4933911ed9ae41dae63b 2023-07-11 18:47:58,025 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf/3282d3fe613544fa84c1c8ddbefedfda.1d2ef9ec9d45e1f32fcc1aef658a2608 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf/3282d3fe613544fa84c1c8ddbefedfda.1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:58,025 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf/3282d3fe613544fa84c1c8ddbefedfda.1d2ef9ec9d45e1f32fcc1aef658a2608 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf/3282d3fe613544fa84c1c8ddbefedfda.1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:58,026 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/3282d3fe613544fa84c1c8ddbefedfda to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/3282d3fe613544fa84c1c8ddbefedfda 2023-07-11 18:47:58,027 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf/testSplitCompactWithPriority=1d2ef9ec9d45e1f32fcc1aef658a2608-afa4e12b5dfb4fc690dad56ec1c18765 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/cf/testSplitCompactWithPriority=1d2ef9ec9d45e1f32fcc1aef658a2608-afa4e12b5dfb4fc690dad56ec1c18765 2023-07-11 18:47:58,027 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf/testSplitCompactWithPriority=1d2ef9ec9d45e1f32fcc1aef658a2608-1aab0297edfc4933911ed9ae41dae63b to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/cf/testSplitCompactWithPriority=1d2ef9ec9d45e1f32fcc1aef658a2608-1aab0297edfc4933911ed9ae41dae63b 2023-07-11 18:47:58,028 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/afa4e12b5dfb4fc690dad56ec1c18765 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/cf/afa4e12b5dfb4fc690dad56ec1c18765 2023-07-11 18:47:58,030 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/recovered.edits/28.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e/recovered.edits/28.seqid 2023-07-11 18:47:58,030 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/recovered.edits/28.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67/recovered.edits/28.seqid 2023-07-11 18:47:58,031 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1e974fc58d5881584f83b96e6a97fd7e 2023-07-11 18:47:58,031 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/2832a423cab04e28bf5780d6f14e3b67 2023-07-11 18:47:58,032 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/recovered.edits/25.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608/recovered.edits/25.seqid 2023-07-11 18:47:58,032 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitCompactWithPriority/1d2ef9ec9d45e1f32fcc1aef658a2608 2023-07-11 18:47:58,032 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testSplitCompactWithPriority regions 2023-07-11 18:47:58,035 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=199, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testSplitCompactWithPriority 2023-07-11 18:47:58,036 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testSplitCompactWithPriority from hbase:meta 2023-07-11 18:47:58,038 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testSplitCompactWithPriority' descriptor. 2023-07-11 18:47:58,039 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=199, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testSplitCompactWithPriority 2023-07-11 18:47:58,039 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testSplitCompactWithPriority' from region states. 2023-07-11 18:47:58,039 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101278039"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:58,039 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101278039"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:58,039 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101278039"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:58,041 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-07-11 18:47:58,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1d2ef9ec9d45e1f32fcc1aef658a2608, NAME => 'testSplitCompactWithPriority,,1689101272409.1d2ef9ec9d45e1f32fcc1aef658a2608.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 2832a423cab04e28bf5780d6f14e3b67, NAME => 'testSplitCompactWithPriority,,1689101273513.2832a423cab04e28bf5780d6f14e3b67.', STARTKEY => '', ENDKEY => 'row4'}, {ENCODED => 1e974fc58d5881584f83b96e6a97fd7e, NAME => 'testSplitCompactWithPriority,row4,1689101273513.1e974fc58d5881584f83b96e6a97fd7e.', STARTKEY => 'row4', ENDKEY => ''}] 2023-07-11 18:47:58,041 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testSplitCompactWithPriority' as deleted. 2023-07-11 18:47:58,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitCompactWithPriority","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101278041"}]},"ts":"9223372036854775807"} 2023-07-11 18:47:58,042 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testSplitCompactWithPriority state from META 2023-07-11 18:47:58,045 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=199, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testSplitCompactWithPriority 2023-07-11 18:47:58,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=199, state=SUCCESS; DeleteTableProcedure table=testSplitCompactWithPriority in 33 msec 2023-07-11 18:47:58,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=199 2023-07-11 18:47:58,116 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testSplitCompactWithPriority, procId: 199 completed 2023-07-11 18:47:58,131 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testSplitCompactWithPriority Thread=419 (was 428), OpenFileDescriptor=752 (was 752), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 204), ProcessCount=170 (was 170), AvailableMemoryMB=7562 (was 7587) 2023-07-11 18:47:58,147 INFO [Listener at localhost/44535] hbase.ResourceChecker(147): before: regionserver.TestSplitTransactionOnCluster#testSplitWithRegionReplicas Thread=419, OpenFileDescriptor=752, MaxFileDescriptor=60000, SystemLoadAverage=181, ProcessCount=170, AvailableMemoryMB=7562 2023-07-11 18:47:58,148 INFO [Listener at localhost/44535] hbase.LocalHBaseCluster(262): Not alive RS:1;jenkins-hbase9:41081 2023-07-11 18:47:58,148 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3275): A region server is stopped or stopping:jenkins-hbase9.apache.org,41081,1689101231767 2023-07-11 18:47:58,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testSplitWithRegionReplicas', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '2', coprocessor$1 => '|org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro|1073741823|'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily11', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 18:47:58,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=200, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testSplitWithRegionReplicas 2023-07-11 18:47:58,153 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=200, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testSplitWithRegionReplicas execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 18:47:58,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testSplitWithRegionReplicas" procId is: 200 2023-07-11 18:47:58,153 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=200, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testSplitWithRegionReplicas execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 18:47:58,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=200 2023-07-11 18:47:58,155 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,155 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51 empty. 2023-07-11 18:47:58,156 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,156 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testSplitWithRegionReplicas regions 2023-07-11 18:47:58,166 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/.tabledesc/.tableinfo.0000000001 2023-07-11 18:47:58,167 INFO [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ca22a42d7d4b020624695bead405f51, NAME => 'testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testSplitWithRegionReplicas', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '2', coprocessor$1 => '|org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro|1073741823|'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily11', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily21', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'colfamily31', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'false', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp 2023-07-11 18:47:58,174 DEBUG [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(866): Instantiated testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:58,174 DEBUG [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(1604): Closing 1ca22a42d7d4b020624695bead405f51, disabling compactions & flushes 2023-07-11 18:47:58,174 INFO [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(1626): Closing region testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,174 DEBUG [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,174 DEBUG [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(1714): Acquired close lock on testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. after waiting 0 ms 2023-07-11 18:47:58,174 DEBUG [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(1724): Updates disabled for region testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,174 INFO [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(1838): Closed testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,174 DEBUG [RegionOpenAndInit-testSplitWithRegionReplicas-pool-0] regionserver.HRegion(1558): Region close journal for 1ca22a42d7d4b020624695bead405f51: 2023-07-11 18:47:58,176 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=200, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testSplitWithRegionReplicas execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 18:47:58,177 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":5,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101278177"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101278177"},{"qualifier":"server_0001","vlen":0,"tag":[],"timestamp":"1689101278177"},{"qualifier":"serverstartcode_0001","vlen":0,"tag":[],"timestamp":"1689101278177"}]},"ts":"1689101278177"} 2023-07-11 18:47:58,178 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 18:47:58,179 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=200, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testSplitWithRegionReplicas execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 18:47:58,179 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitWithRegionReplicas","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101278179"}]},"ts":"1689101278179"} 2023-07-11 18:47:58,180 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testSplitWithRegionReplicas, state=ENABLING in hbase:meta 2023-07-11 18:47:58,183 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:58,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:58,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:58,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 18:47:58,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=3, number of hosts=1, number of racks=1 2023-07-11 18:47:58,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=201, ppid=200, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=1ca22a42d7d4b020624695bead405f51, ASSIGN}, {pid=202, ppid=200, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=dd0141f7f986afb495dcb1cd78577d7b, ASSIGN}] 2023-07-11 18:47:58,186 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=202, ppid=200, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=dd0141f7f986afb495dcb1cd78577d7b, ASSIGN 2023-07-11 18:47:58,186 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=201, ppid=200, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=1ca22a42d7d4b020624695bead405f51, ASSIGN 2023-07-11 18:47:58,187 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=201, ppid=200, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=1ca22a42d7d4b020624695bead405f51, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:58,187 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=202, ppid=200, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=dd0141f7f986afb495dcb1cd78577d7b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:58,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=200 2023-07-11 18:47:58,337 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 18:47:58,339 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=201 updating hbase:meta row=1ca22a42d7d4b020624695bead405f51, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,339 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=202 updating hbase:meta row=dd0141f7f986afb495dcb1cd78577d7b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,339 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101278339"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101278339"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101278339"}]},"ts":"1689101278339"} 2023-07-11 18:47:58,339 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101278339"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689101278339"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689101278339"}]},"ts":"1689101278339"} 2023-07-11 18:47:58,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=203, ppid=201, state=RUNNABLE; OpenRegionProcedure 1ca22a42d7d4b020624695bead405f51, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:58,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=204, ppid=202, state=RUNNABLE; OpenRegionProcedure dd0141f7f986afb495dcb1cd78577d7b, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:58,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=200 2023-07-11 18:47:58,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:58,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ca22a42d7d4b020624695bead405f51, NAME => 'testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:58,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd0141f7f986afb495dcb1cd78577d7b, NAME => 'testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b.', STARTKEY => '', ENDKEY => '', REPLICA_ID => 1} 2023-07-11 18:47:58,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro with path null and priority 1073741823 2023-07-11 18:47:58,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro with path null and priority 1073741823 2023-07-11 18:47:58,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro from HTD of testSplitWithRegionReplicas successfully. 2023-07-11 18:47:58,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro from HTD of testSplitWithRegionReplicas successfully. 2023-07-11 18:47:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitWithRegionReplicas 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitWithRegionReplicas dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:58,501 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:58,502 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,503 DEBUG [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf 2023-07-11 18:47:58,503 DEBUG [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf 2023-07-11 18:47:58,503 DEBUG [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf 2023-07-11 18:47:58,503 DEBUG [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf 2023-07-11 18:47:58,503 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ca22a42d7d4b020624695bead405f51 columnFamilyName cf 2023-07-11 18:47:58,503 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd0141f7f986afb495dcb1cd78577d7b columnFamilyName cf 2023-07-11 18:47:58,504 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] regionserver.HStore(310): Store=1ca22a42d7d4b020624695bead405f51/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:58,504 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] regionserver.HStore(310): Store=dd0141f7f986afb495dcb1cd78577d7b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:58,504 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,504 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:58,505 DEBUG [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily11 2023-07-11 18:47:58,505 DEBUG [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily11 2023-07-11 18:47:58,505 DEBUG [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily11 2023-07-11 18:47:58,505 DEBUG [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily11 2023-07-11 18:47:58,506 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ca22a42d7d4b020624695bead405f51 columnFamilyName colfamily11 2023-07-11 18:47:58,506 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd0141f7f986afb495dcb1cd78577d7b columnFamilyName colfamily11 2023-07-11 18:47:58,506 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] regionserver.HStore(310): Store=1ca22a42d7d4b020624695bead405f51/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:58,506 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] regionserver.HStore(310): Store=dd0141f7f986afb495dcb1cd78577d7b/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:58,506 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,506 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:58,507 DEBUG [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily21 2023-07-11 18:47:58,507 DEBUG [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily21 2023-07-11 18:47:58,507 DEBUG [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily21 2023-07-11 18:47:58,508 DEBUG [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily21 2023-07-11 18:47:58,508 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ca22a42d7d4b020624695bead405f51 columnFamilyName colfamily21 2023-07-11 18:47:58,508 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd0141f7f986afb495dcb1cd78577d7b columnFamilyName colfamily21 2023-07-11 18:47:58,508 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] regionserver.HStore(310): Store=1ca22a42d7d4b020624695bead405f51/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:58,508 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] regionserver.HStore(310): Store=dd0141f7f986afb495dcb1cd78577d7b/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:58,508 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,508 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:58,509 DEBUG [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily31 2023-07-11 18:47:58,509 DEBUG [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily31 2023-07-11 18:47:58,509 DEBUG [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily31 2023-07-11 18:47:58,510 DEBUG [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily31 2023-07-11 18:47:58,510 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ca22a42d7d4b020624695bead405f51 columnFamilyName colfamily31 2023-07-11 18:47:58,510 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd0141f7f986afb495dcb1cd78577d7b columnFamilyName colfamily31 2023-07-11 18:47:58,510 INFO [StoreOpener-1ca22a42d7d4b020624695bead405f51-1] regionserver.HStore(310): Store=1ca22a42d7d4b020624695bead405f51/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:58,510 INFO [StoreOpener-dd0141f7f986afb495dcb1cd78577d7b-1] regionserver.HStore(310): Store=dd0141f7f986afb495dcb1cd78577d7b/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:58,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testSplitWithRegionReplicas descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0 M)) instead. 2023-07-11 18:47:58,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened dd0141f7f986afb495dcb1cd78577d7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74699757, jitterRate=0.11311312019824982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=33554432} 2023-07-11 18:47:58,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for dd0141f7f986afb495dcb1cd78577d7b: 2023-07-11 18:47:58,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b., pid=204, masterSystemTime=1689101278492 2023-07-11 18:47:58,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:58,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:58,514 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=202 updating hbase:meta row=dd0141f7f986afb495dcb1cd78577d7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,515 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101278514"},{"qualifier":"server_0001","vlen":31,"tag":[],"timestamp":"1689101278514"},{"qualifier":"serverstartcode_0001","vlen":8,"tag":[],"timestamp":"1689101278514"},{"qualifier":"seqnumDuringOpen_0001","vlen":8,"tag":[],"timestamp":"1689101278514"}]},"ts":"1689101278514"} 2023-07-11 18:47:58,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testSplitWithRegionReplicas descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0 M)) instead. 2023-07-11 18:47:58,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:58,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=204, resume processing ppid=202 2023-07-11 18:47:58,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=204, ppid=202, state=SUCCESS; OpenRegionProcedure dd0141f7f986afb495dcb1cd78577d7b, server=jenkins-hbase9.apache.org,34803,1689101231723 in 175 msec 2023-07-11 18:47:58,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 18:47:58,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=202, ppid=200, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=dd0141f7f986afb495dcb1cd78577d7b, ASSIGN in 333 msec 2023-07-11 18:47:58,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1ca22a42d7d4b020624695bead405f51; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72866847, jitterRate=0.08580063283443451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=33554432} 2023-07-11 18:47:58,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1ca22a42d7d4b020624695bead405f51: 2023-07-11 18:47:58,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51., pid=203, masterSystemTime=1689101278492 2023-07-11 18:47:58,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,522 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=201 updating hbase:meta row=1ca22a42d7d4b020624695bead405f51, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,522 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101278522"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101278522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101278522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101278522"}]},"ts":"1689101278522"} 2023-07-11 18:47:58,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=203, resume processing ppid=201 2023-07-11 18:47:58,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=203, ppid=201, state=SUCCESS; OpenRegionProcedure 1ca22a42d7d4b020624695bead405f51, server=jenkins-hbase9.apache.org,40505,1689101231800 in 183 msec 2023-07-11 18:47:58,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=201, resume processing ppid=200 2023-07-11 18:47:58,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=201, ppid=200, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=1ca22a42d7d4b020624695bead405f51, ASSIGN in 340 msec 2023-07-11 18:47:58,527 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=200, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testSplitWithRegionReplicas execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 18:47:58,527 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitWithRegionReplicas","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101278527"}]},"ts":"1689101278527"} 2023-07-11 18:47:58,528 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitWithRegionReplicas, state=ENABLED in hbase:meta 2023-07-11 18:47:58,530 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=200, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testSplitWithRegionReplicas execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 18:47:58,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=200, state=SUCCESS; CreateTableProcedure table=testSplitWithRegionReplicas in 379 msec 2023-07-11 18:47:58,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=200 2023-07-11 18:47:58,757 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testSplitWithRegionReplicas, procId: 200 completed 2023-07-11 18:47:58,758 DEBUG [Listener at localhost/44535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testSplitWithRegionReplicas get assigned. Timeout = 60000ms 2023-07-11 18:47:58,758 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:58,760 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=34803] regionserver.StoreScanner(1093): Switch to stream read (scanned=32846 bytes) of info 2023-07-11 18:47:58,762 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3484): All regions for table testSplitWithRegionReplicas assigned to meta. Checking AM states. 2023-07-11 18:47:58,762 INFO [Listener at localhost/44535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 18:47:58,763 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(3504): All regions for table testSplitWithRegionReplicas assigned. 2023-07-11 18:47:58,773 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(767): OLDREGION {ENCODED => dd0141f7f986afb495dcb1cd78577d7b, NAME => 'testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b.', STARTKEY => '', ENDKEY => '', REPLICA_ID => 1} 2023-07-11 18:47:58,773 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(767): OLDREGION {ENCODED => 1ca22a42d7d4b020624695bead405f51, NAME => 'testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.', STARTKEY => '', ENDKEY => ''} 2023-07-11 18:47:58,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(936): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-07-11 18:47:58,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure.ProcedureCoordinator(165): Submitting procedure testSplitWithRegionReplicas 2023-07-11 18:47:58,782 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testSplitWithRegionReplicas' 2023-07-11 18:47:58,783 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:58,783 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testSplitWithRegionReplicas' starting 'acquire' 2023-07-11 18:47:58,783 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testSplitWithRegionReplicas', kicking off acquire phase on members. 2023-07-11 18:47:58,783 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,783 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,785 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:58,785 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:58,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:58,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:58,785 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,785 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:58,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,786 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,786 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitWithRegionReplicas' with timeout 60000ms 2023-07-11 18:47:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitWithRegionReplicas 2023-07-11 18:47:58,787 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testSplitWithRegionReplicas 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitWithRegionReplicas' starting 'acquire' stage 2023-07-11 18:47:58,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitWithRegionReplicas 2023-07-11 18:47:58,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testSplitWithRegionReplicas 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitWithRegionReplicas' with timeout 60000ms 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testSplitWithRegionReplicas' with timeout 60000ms 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitWithRegionReplicas' starting 'acquire' stage 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testSplitWithRegionReplicas' starting 'acquire' stage 2023-07-11 18:47:58,787 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitWithRegionReplicas' locally acquired 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,33849,1689101240752' joining acquired barrier for procedure (testSplitWithRegionReplicas) in zk 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-07-11 18:47:58,787 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-07-11 18:47:58,787 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,787 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. started... 2023-07-11 18:47:58,787 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. started... 2023-07-11 18:47:58,789 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] regionserver.HRegion(2404): NOT flushing testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. as writes are not enabled 2023-07-11 18:47:58,789 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ca22a42d7d4b020624695bead405f51 4/4 column families, dataSize=116 B heapSize=1.41 KB 2023-07-11 18:47:58,789 DEBUG [rs(jenkins-hbase9.apache.org,34803,1689101231723)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:58,789 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:58,789 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:58,789 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,789 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitWithRegionReplicas' locally acquired 2023-07-11 18:47:58,789 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure (testSplitWithRegionReplicas) in zk 2023-07-11 18:47:58,790 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,790 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,790 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitWithRegionReplicas' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:58,791 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,791 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:58,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:58,791 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,791 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitWithRegionReplicas' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:58,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:58,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:58,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:58,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,34803,1689101231723' joining acquired barrier for procedure 'testSplitWithRegionReplicas' on coordinator 2023-07-11 18:47:58,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46796ef0[Count = 1] remaining members to acquire global barrier 2023-07-11 18:47:58,801 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=8 (bloomFilter=false), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/.tmp/cf/5fc6a689da0e437dacabcff06f97181d 2023-07-11 18:47:58,807 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/.tmp/cf/5fc6a689da0e437dacabcff06f97181d as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d 2023-07-11 18:47:58,811 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d, entries=4, sequenceid=8, filesize=4.7 K 2023-07-11 18:47:58,812 INFO [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~116 B/116, heapSize ~656 B/656, currentSize=0 B/0 for 1ca22a42d7d4b020624695bead405f51 in 23ms, sequenceid=8, compaction requested=false 2023-07-11 18:47:58,812 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testSplitWithRegionReplicas' 2023-07-11 18:47:58,812 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ca22a42d7d4b020624695bead405f51: 2023-07-11 18:47:58,812 DEBUG [rs(jenkins-hbase9.apache.org,40505,1689101231800)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,812 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-07-11 18:47:58,812 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-07-11 18:47:58,812 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,812 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testSplitWithRegionReplicas' locally acquired 2023-07-11 18:47:58,812 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure (testSplitWithRegionReplicas) in zk 2023-07-11 18:47:58,814 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,814 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:58,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:58,814 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,814 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testSplitWithRegionReplicas' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 18:47:58,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:58,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:58,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:58,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40505,1689101231800' joining acquired barrier for procedure 'testSplitWithRegionReplicas' on coordinator 2023-07-11 18:47:58,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46796ef0[Count = 0] remaining members to acquire global barrier 2023-07-11 18:47:58,816 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testSplitWithRegionReplicas' starting 'in-barrier' execution. 2023-07-11 18:47:58,816 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,818 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,819 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,818 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitWithRegionReplicas' received 'reached' from coordinator. 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitWithRegionReplicas' received 'reached' from coordinator. 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitWithRegionReplicas' locally completed 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitWithRegionReplicas' completed for member 'jenkins-hbase9.apache.org,40505,1689101231800' in zk 2023-07-11 18:47:58,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitWithRegionReplicas' locally completed 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitWithRegionReplicas' completed for member 'jenkins-hbase9.apache.org,33849,1689101240752' in zk 2023-07-11 18:47:58,819 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testSplitWithRegionReplicas' received 'reached' from coordinator. 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testSplitWithRegionReplicas' locally completed 2023-07-11 18:47:58,819 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testSplitWithRegionReplicas' completed for member 'jenkins-hbase9.apache.org,34803,1689101231723' in zk 2023-07-11 18:47:58,819 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,819 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 18:47:58,820 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitWithRegionReplicas' has notified controller of completion 2023-07-11 18:47:58,820 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,820 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:58,820 DEBUG [member: 'jenkins-hbase9.apache.org,40505,1689101231800' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitWithRegionReplicas' completed. 2023-07-11 18:47:58,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:58,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:58,821 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitWithRegionReplicas' has notified controller of completion 2023-07-11 18:47:58,821 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:58,821 DEBUG [member: 'jenkins-hbase9.apache.org,33849,1689101240752' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitWithRegionReplicas' completed. 2023-07-11 18:47:58,822 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,822 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testSplitWithRegionReplicas' has notified controller of completion 2023-07-11 18:47:58,822 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:58,822 DEBUG [member: 'jenkins-hbase9.apache.org,34803,1689101231723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testSplitWithRegionReplicas' completed. 2023-07-11 18:47:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitWithRegionReplicas' member 'jenkins-hbase9.apache.org,40505,1689101231800': 2023-07-11 18:47:58,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40505,1689101231800' released barrier for procedure'testSplitWithRegionReplicas', counting down latch. Waiting for 1 more 2023-07-11 18:47:58,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:58,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:58,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:58,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:58,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:58,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testSplitWithRegionReplicas' member 'jenkins-hbase9.apache.org,34803,1689101231723': 2023-07-11 18:47:58,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,34803,1689101231723' released barrier for procedure'testSplitWithRegionReplicas', counting down latch. Waiting for 0 more 2023-07-11 18:47:58,827 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testSplitWithRegionReplicas' execution completed 2023-07-11 18:47:58,827 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 18:47:58,827 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 18:47:58,827 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testSplitWithRegionReplicas 2023-07-11 18:47:58,827 INFO [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testSplitWithRegionReplicasincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-07-11 18:47:58,830 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-07-11 18:47:58,830 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:58,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,830 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:58,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:58,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,831 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 18:47:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,831 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 18:47:58,833 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testSplitWithRegionReplicas 2023-07-11 18:47:58,833 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,833 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:58,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:58,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:58,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:58,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-07-11 18:47:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:58,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:58,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:58,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-07-11 18:47:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:58,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-07-11 18:47:58,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 18:47:58,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:58,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-07-11 18:47:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 18:47:58,837 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,837 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testSplitWithRegionReplicas 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,838 DEBUG [(jenkins-hbase9.apache.org,36851,1689101253218)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testSplitWithRegionReplicas' 2023-07-11 18:47:58,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testSplitWithRegionReplicas 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testSplitWithRegionReplicas 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testSplitWithRegionReplicas'' to complete. (max 20000 ms per retry) 2023-07-11 18:47:58,838 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-07-11 18:47:58,938 DEBUG [Listener at localhost/44535] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-07-11 18:47:58,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-07-11 18:47:58,941 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:47:58,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=false 2023-07-11 18:47:58,943 INFO [Listener at localhost/44535] master.HMaster$3(1981): Client=null/null split testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:58,944 DEBUG [Listener at localhost/44535] assignment.SplitTableRegionProcedure(219): Splittable=true state=OPEN, location=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,944 DEBUG [Listener at localhost/44535] procedure2.ProcedureExecutor(1029): Stored pid=205, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitWithRegionReplicas, parent=1ca22a42d7d4b020624695bead405f51, daughterA=68acde32baeae53019d8623f9deb81b3, daughterB=d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:58,945 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=205, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitWithRegionReplicas, parent=1ca22a42d7d4b020624695bead405f51, daughterA=68acde32baeae53019d8623f9deb81b3, daughterB=d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:58,946 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=205, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitWithRegionReplicas, parent=1ca22a42d7d4b020624695bead405f51, daughterA=68acde32baeae53019d8623f9deb81b3, daughterB=d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:58,946 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=205, state=RUNNABLE:SPLIT_TABLE_REGION_PREPARE; SplitTableRegionProcedure table=testSplitWithRegionReplicas, parent=1ca22a42d7d4b020624695bead405f51, daughterA=68acde32baeae53019d8623f9deb81b3, daughterB=d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:58,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=206, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=1ca22a42d7d4b020624695bead405f51, UNASSIGN}, {pid=207, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=dd0141f7f986afb495dcb1cd78577d7b, UNASSIGN}] 2023-07-11 18:47:58,947 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=206, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=1ca22a42d7d4b020624695bead405f51, UNASSIGN 2023-07-11 18:47:58,947 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=207, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=dd0141f7f986afb495dcb1cd78577d7b, UNASSIGN 2023-07-11 18:47:58,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=206 updating hbase:meta row=1ca22a42d7d4b020624695bead405f51, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:58,948 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=207 updating hbase:meta row=dd0141f7f986afb495dcb1cd78577d7b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:58,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101278948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101278948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101278948"}]},"ts":"1689101278948"} 2023-07-11 18:47:58,948 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101278948"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689101278948"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689101278948"}]},"ts":"1689101278948"} 2023-07-11 18:47:58,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=208, ppid=206, state=RUNNABLE; CloseRegionProcedure 1ca22a42d7d4b020624695bead405f51, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:58,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=209, ppid=207, state=RUNNABLE; CloseRegionProcedure dd0141f7f986afb495dcb1cd78577d7b, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:59,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:59,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:59,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1ca22a42d7d4b020624695bead405f51, disabling compactions & flushes 2023-07-11 18:47:59,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing dd0141f7f986afb495dcb1cd78577d7b, disabling compactions & flushes 2023-07-11 18:47:59,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:59,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:59,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:59,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:59,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. after waiting 0 ms 2023-07-11 18:47:59,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:59,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. after waiting 0 ms 2023-07-11 18:47:59,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:59,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro 2023-07-11 18:47:59,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitWithRegionReplicas,,1689101278150_0001.dd0141f7f986afb495dcb1cd78577d7b. 2023-07-11 18:47:59,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for dd0141f7f986afb495dcb1cd78577d7b: 2023-07-11 18:47:59,105 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=207 updating hbase:meta row=dd0141f7f986afb495dcb1cd78577d7b, regionState=CLOSED 2023-07-11 18:47:59,105 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101279105"},{"qualifier":"state_0001","vlen":6,"tag":[],"timestamp":"1689101279105"}]},"ts":"1689101279105"} 2023-07-11 18:47:59,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed dd0141f7f986afb495dcb1cd78577d7b 2023-07-11 18:47:59,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2023-07-11 18:47:59,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro 2023-07-11 18:47:59,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. 2023-07-11 18:47:59,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1ca22a42d7d4b020624695bead405f51: 2023-07-11 18:47:59,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:59,107 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=206 updating hbase:meta row=1ca22a42d7d4b020624695bead405f51, regionState=CLOSED 2023-07-11 18:47:59,107 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101279107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101279107"}]},"ts":"1689101279107"} 2023-07-11 18:47:59,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=209, resume processing ppid=207 2023-07-11 18:47:59,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=209, ppid=207, state=SUCCESS; CloseRegionProcedure dd0141f7f986afb495dcb1cd78577d7b, server=jenkins-hbase9.apache.org,34803,1689101231723 in 157 msec 2023-07-11 18:47:59,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=207, ppid=205, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=dd0141f7f986afb495dcb1cd78577d7b, UNASSIGN in 160 msec 2023-07-11 18:47:59,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=208, resume processing ppid=206 2023-07-11 18:47:59,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=208, ppid=206, state=SUCCESS; CloseRegionProcedure 1ca22a42d7d4b020624695bead405f51, server=jenkins-hbase9.apache.org,40505,1689101231800 in 159 msec 2023-07-11 18:47:59,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=206, resume processing ppid=205 2023-07-11 18:47:59,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=206, ppid=205, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=1ca22a42d7d4b020624695bead405f51, UNASSIGN in 162 msec 2023-07-11 18:47:59,117 INFO [PEWorker-3] assignment.SplitTableRegionProcedure(694): pid=205 splitting 1 storefiles, region=1ca22a42d7d4b020624695bead405f51, threads=1 2023-07-11 18:47:59,117 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(776): pid=205 splitting started for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d for region: 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:59,138 DEBUG [StoreFileSplitter-pool-0] assignment.SplitTableRegionProcedure(787): pid=205 splitting complete for store file: hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d for region: 1ca22a42d7d4b020624695bead405f51 2023-07-11 18:47:59,138 DEBUG [PEWorker-3] assignment.SplitTableRegionProcedure(755): pid=205 split storefiles for region 1ca22a42d7d4b020624695bead405f51 Daughter A: 1 storefiles, Daughter B: 1 storefiles. 2023-07-11 18:47:59,158 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=-1 2023-07-11 18:47:59,160 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=-1 2023-07-11 18:47:59,161 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"regioninfo","vlen":61,"tag":[],"timestamp":"1689101279161"},{"qualifier":"splitA","vlen":65,"tag":[],"timestamp":"1689101279161"},{"qualifier":"splitB","vlen":65,"tag":[],"timestamp":"1689101279161"}]},"ts":"1689101279161"} 2023-07-11 18:47:59,161 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":6,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101279161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101279161"},{"qualifier":"server_0001","vlen":0,"tag":[],"timestamp":"1689101279161"}]},"ts":"1689101279161"} 2023-07-11 18:47:59,161 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":6,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101279161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101279161"},{"qualifier":"server_0001","vlen":0,"tag":[],"timestamp":"1689101279161"}]},"ts":"1689101279161"} 2023-07-11 18:47:59,164 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-11 18:47:59,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 18:47:59,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 18:47:59,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=3, number of hosts=1, number of racks=1 2023-07-11 18:47:59,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=210, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=68acde32baeae53019d8623f9deb81b3, ASSIGN}, {pid=211, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=d5d18c65141b22d5e3aacc360fc9aeb2, ASSIGN}, {pid=212, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=bfa49f88ac100cd2382e0c620b7a7ec3, ASSIGN}, {pid=213, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=7997fb810a9b8c01fb0f4febf4dbe180, ASSIGN}] 2023-07-11 18:47:59,172 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=211, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=d5d18c65141b22d5e3aacc360fc9aeb2, ASSIGN 2023-07-11 18:47:59,172 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=212, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=bfa49f88ac100cd2382e0c620b7a7ec3, ASSIGN 2023-07-11 18:47:59,172 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=213, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=7997fb810a9b8c01fb0f4febf4dbe180, ASSIGN 2023-07-11 18:47:59,172 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=210, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=68acde32baeae53019d8623f9deb81b3, ASSIGN 2023-07-11 18:47:59,172 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=211, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=d5d18c65141b22d5e3aacc360fc9aeb2, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:59,172 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=212, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=bfa49f88ac100cd2382e0c620b7a7ec3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,33849,1689101240752; forceNewPlan=false, retain=false 2023-07-11 18:47:59,172 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=213, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=7997fb810a9b8c01fb0f4febf4dbe180, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,34803,1689101231723; forceNewPlan=false, retain=false 2023-07-11 18:47:59,172 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=210, ppid=205, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=68acde32baeae53019d8623f9deb81b3, ASSIGN; state=SPLITTING_NEW, location=jenkins-hbase9.apache.org,40505,1689101231800; forceNewPlan=false, retain=false 2023-07-11 18:47:59,178 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-07-11 18:47:59,322 INFO [jenkins-hbase9:36851] balancer.BaseLoadBalancer(1545): Reassigned 4 regions. 4 retained the pre-restart assignment. 2023-07-11 18:47:59,325 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=210 updating hbase:meta row=68acde32baeae53019d8623f9deb81b3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:59,325 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=212 updating hbase:meta row=bfa49f88ac100cd2382e0c620b7a7ec3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:59,325 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=211 updating hbase:meta row=d5d18c65141b22d5e3aacc360fc9aeb2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:59,325 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279325"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689101279325"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689101279325"}]},"ts":"1689101279325"} 2023-07-11 18:47:59,325 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101279325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101279325"}]},"ts":"1689101279325"} 2023-07-11 18:47:59,325 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101279325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101279325"}]},"ts":"1689101279325"} 2023-07-11 18:47:59,325 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=213 updating hbase:meta row=7997fb810a9b8c01fb0f4febf4dbe180, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:59,325 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279325"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689101279325"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689101279325"}]},"ts":"1689101279325"} 2023-07-11 18:47:59,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=214, ppid=212, state=RUNNABLE; OpenRegionProcedure bfa49f88ac100cd2382e0c620b7a7ec3, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:47:59,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=215, ppid=211, state=RUNNABLE; OpenRegionProcedure d5d18c65141b22d5e3aacc360fc9aeb2, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:59,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=216, ppid=210, state=RUNNABLE; OpenRegionProcedure 68acde32baeae53019d8623f9deb81b3, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:47:59,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=217, ppid=213, state=RUNNABLE; OpenRegionProcedure 7997fb810a9b8c01fb0f4febf4dbe180, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:47:59,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3. 2023-07-11 18:47:59,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2. 2023-07-11 18:47:59,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bfa49f88ac100cd2382e0c620b7a7ec3, NAME => 'testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3.', STARTKEY => '', ENDKEY => 'row2', REPLICA_ID => 1} 2023-07-11 18:47:59,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5d18c65141b22d5e3aacc360fc9aeb2, NAME => 'testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.', STARTKEY => 'row2', ENDKEY => ''} 2023-07-11 18:47:59,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180. 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro with path null and priority 1073741823 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro with path null and priority 1073741823 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7997fb810a9b8c01fb0f4febf4dbe180, NAME => 'testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180.', STARTKEY => 'row2', ENDKEY => '', REPLICA_ID => 1} 2023-07-11 18:47:59,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro from HTD of testSplitWithRegionReplicas successfully. 2023-07-11 18:47:59,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro from HTD of testSplitWithRegionReplicas successfully. 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitWithRegionReplicas bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitWithRegionReplicas d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro with path null and priority 1073741823 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:59,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro from HTD of testSplitWithRegionReplicas successfully. 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitWithRegionReplicas 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:59,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:47:59,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:47:59,483 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:47:59,483 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:47:59,483 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,484 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf 2023-07-11 18:47:59,484 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf 2023-07-11 18:47:59,484 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf 2023-07-11 18:47:59,484 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf 2023-07-11 18:47:59,484 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfa49f88ac100cd2382e0c620b7a7ec3 columnFamilyName cf 2023-07-11 18:47:59,484 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7997fb810a9b8c01fb0f4febf4dbe180 columnFamilyName cf 2023-07-11 18:47:59,484 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf 2023-07-11 18:47:59,484 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf 2023-07-11 18:47:59,485 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d18c65141b22d5e3aacc360fc9aeb2 columnFamilyName cf 2023-07-11 18:47:59,492 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf/5fc6a689da0e437dacabcff06f97181d.1ca22a42d7d4b020624695bead405f51->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d-top 2023-07-11 18:47:59,492 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf/5fc6a689da0e437dacabcff06f97181d.1ca22a42d7d4b020624695bead405f51->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d-top 2023-07-11 18:47:59,492 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(310): Store=d5d18c65141b22d5e3aacc360fc9aeb2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,492 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(310): Store=7997fb810a9b8c01fb0f4febf4dbe180/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,492 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:47:59,492 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,493 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf/5fc6a689da0e437dacabcff06f97181d.1ca22a42d7d4b020624695bead405f51->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d-bottom 2023-07-11 18:47:59,494 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(310): Store=bfa49f88ac100cd2382e0c620b7a7ec3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,494 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:47:59,494 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily11 2023-07-11 18:47:59,494 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily11 2023-07-11 18:47:59,494 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily11 2023-07-11 18:47:59,494 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily11 2023-07-11 18:47:59,494 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7997fb810a9b8c01fb0f4febf4dbe180 columnFamilyName colfamily11 2023-07-11 18:47:59,494 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d18c65141b22d5e3aacc360fc9aeb2 columnFamilyName colfamily11 2023-07-11 18:47:59,495 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(310): Store=7997fb810a9b8c01fb0f4febf4dbe180/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,495 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(310): Store=d5d18c65141b22d5e3aacc360fc9aeb2/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,495 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:47:59,495 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,496 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily21 2023-07-11 18:47:59,496 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily21 2023-07-11 18:47:59,496 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily21 2023-07-11 18:47:59,496 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily21 2023-07-11 18:47:59,497 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7997fb810a9b8c01fb0f4febf4dbe180 columnFamilyName colfamily21 2023-07-11 18:47:59,497 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d18c65141b22d5e3aacc360fc9aeb2 columnFamilyName colfamily21 2023-07-11 18:47:59,497 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(310): Store=7997fb810a9b8c01fb0f4febf4dbe180/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,497 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:47:59,497 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(310): Store=d5d18c65141b22d5e3aacc360fc9aeb2/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,497 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,502 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily31 2023-07-11 18:47:59,502 DEBUG [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily31 2023-07-11 18:47:59,502 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7997fb810a9b8c01fb0f4febf4dbe180 columnFamilyName colfamily31 2023-07-11 18:47:59,502 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily31 2023-07-11 18:47:59,502 DEBUG [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily31 2023-07-11 18:47:59,502 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily11 2023-07-11 18:47:59,502 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily11 2023-07-11 18:47:59,502 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d18c65141b22d5e3aacc360fc9aeb2 columnFamilyName colfamily31 2023-07-11 18:47:59,503 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfa49f88ac100cd2382e0c620b7a7ec3 columnFamilyName colfamily11 2023-07-11 18:47:59,503 INFO [StoreOpener-7997fb810a9b8c01fb0f4febf4dbe180-1] regionserver.HStore(310): Store=7997fb810a9b8c01fb0f4febf4dbe180/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testSplitWithRegionReplicas descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0 M)) instead. 2023-07-11 18:47:59,503 INFO [StoreOpener-d5d18c65141b22d5e3aacc360fc9aeb2-1] regionserver.HStore(310): Store=d5d18c65141b22d5e3aacc360fc9aeb2/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,503 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(310): Store=bfa49f88ac100cd2382e0c620b7a7ec3/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,503 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:47:59,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7997fb810a9b8c01fb0f4febf4dbe180; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65756346, jitterRate=-0.020154088735580444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=33554432} 2023-07-11 18:47:59,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7997fb810a9b8c01fb0f4febf4dbe180: 2023-07-11 18:47:59,504 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily21 2023-07-11 18:47:59,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180., pid=217, masterSystemTime=1689101279479 2023-07-11 18:47:59,504 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily21 2023-07-11 18:47:59,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180.,because compaction is disabled. 2023-07-11 18:47:59,505 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfa49f88ac100cd2382e0c620b7a7ec3 columnFamilyName colfamily21 2023-07-11 18:47:59,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,505 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(310): Store=bfa49f88ac100cd2382e0c620b7a7ec3/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,505 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:47:59,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180. 2023-07-11 18:47:59,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180. 2023-07-11 18:47:59,506 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=213 updating hbase:meta row=7997fb810a9b8c01fb0f4febf4dbe180, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:47:59,506 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279506"},{"qualifier":"server_0001","vlen":31,"tag":[],"timestamp":"1689101279506"},{"qualifier":"serverstartcode_0001","vlen":8,"tag":[],"timestamp":"1689101279506"},{"qualifier":"seqnumDuringOpen_0001","vlen":8,"tag":[],"timestamp":"1689101279506"}]},"ts":"1689101279506"} 2023-07-11 18:47:59,507 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily31 2023-07-11 18:47:59,507 DEBUG [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily31 2023-07-11 18:47:59,507 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfa49f88ac100cd2382e0c620b7a7ec3 columnFamilyName colfamily31 2023-07-11 18:47:59,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testSplitWithRegionReplicas descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0 M)) instead. 2023-07-11 18:47:59,507 INFO [StoreOpener-bfa49f88ac100cd2382e0c620b7a7ec3-1] regionserver.HStore(310): Store=bfa49f88ac100cd2382e0c620b7a7ec3/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testSplitWithRegionReplicas descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0 M)) instead. 2023-07-11 18:47:59,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:47:59,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=217, resume processing ppid=213 2023-07-11 18:47:59,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=217, ppid=213, state=SUCCESS; OpenRegionProcedure 7997fb810a9b8c01fb0f4febf4dbe180, server=jenkins-hbase9.apache.org,34803,1689101231723 in 179 msec 2023-07-11 18:47:59,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened bfa49f88ac100cd2382e0c620b7a7ec3; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59381392, jitterRate=-0.11514830589294434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=33554432} 2023-07-11 18:47:59,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for bfa49f88ac100cd2382e0c620b7a7ec3: 2023-07-11 18:47:59,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3., pid=214, masterSystemTime=1689101279478 2023-07-11 18:47:59,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3.,because compaction is disabled. 2023-07-11 18:47:59,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d5d18c65141b22d5e3aacc360fc9aeb2; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65188491, jitterRate=-0.028615787625312805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=33554432} 2023-07-11 18:47:59,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d5d18c65141b22d5e3aacc360fc9aeb2: 2023-07-11 18:47:59,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=213, ppid=205, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=7997fb810a9b8c01fb0f4febf4dbe180, ASSIGN in 338 msec 2023-07-11 18:47:59,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2., pid=215, masterSystemTime=1689101279478 2023-07-11 18:47:59,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.,because compaction is disabled. 2023-07-11 18:47:59,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3. 2023-07-11 18:47:59,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3. 2023-07-11 18:47:59,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=212 updating hbase:meta row=bfa49f88ac100cd2382e0c620b7a7ec3, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:47:59,511 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279510"},{"qualifier":"server_0001","vlen":31,"tag":[],"timestamp":"1689101279510"},{"qualifier":"serverstartcode_0001","vlen":8,"tag":[],"timestamp":"1689101279510"},{"qualifier":"seqnumDuringOpen_0001","vlen":8,"tag":[],"timestamp":"1689101279510"}]},"ts":"1689101279510"} 2023-07-11 18:47:59,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2. 2023-07-11 18:47:59,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2. 2023-07-11 18:47:59,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3. 2023-07-11 18:47:59,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 68acde32baeae53019d8623f9deb81b3, NAME => 'testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.', STARTKEY => '', ENDKEY => 'row2'} 2023-07-11 18:47:59,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro with path null and priority 1073741823 2023-07-11 18:47:59,512 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=211 updating hbase:meta row=d5d18c65141b22d5e3aacc360fc9aeb2, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:59,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro from HTD of testSplitWithRegionReplicas successfully. 2023-07-11 18:47:59,512 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279511"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101279511"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101279511"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101279511"}]},"ts":"1689101279511"} 2023-07-11 18:47:59,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testSplitWithRegionReplicas 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 18:47:59,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=214, resume processing ppid=212 2023-07-11 18:47:59,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=214, ppid=212, state=SUCCESS; OpenRegionProcedure bfa49f88ac100cd2382e0c620b7a7ec3, server=jenkins-hbase9.apache.org,33849,1689101240752 in 186 msec 2023-07-11 18:47:59,514 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=212, ppid=205, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=bfa49f88ac100cd2382e0c620b7a7ec3, ASSIGN in 342 msec 2023-07-11 18:47:59,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=215, resume processing ppid=211 2023-07-11 18:47:59,515 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf 2023-07-11 18:47:59,515 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf 2023-07-11 18:47:59,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=215, ppid=211, state=SUCCESS; OpenRegionProcedure d5d18c65141b22d5e3aacc360fc9aeb2, server=jenkins-hbase9.apache.org,40505,1689101231800 in 186 msec 2023-07-11 18:47:59,515 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68acde32baeae53019d8623f9deb81b3 columnFamilyName cf 2023-07-11 18:47:59,515 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=211, ppid=205, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=d5d18c65141b22d5e3aacc360fc9aeb2, ASSIGN in 343 msec 2023-07-11 18:47:59,521 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(539): loaded hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf/5fc6a689da0e437dacabcff06f97181d.1ca22a42d7d4b020624695bead405f51->hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d-bottom 2023-07-11 18:47:59,521 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(310): Store=68acde32baeae53019d8623f9deb81b3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,521 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily11 of region 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,522 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily11 2023-07-11 18:47:59,522 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily11 2023-07-11 18:47:59,523 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68acde32baeae53019d8623f9deb81b3 columnFamilyName colfamily11 2023-07-11 18:47:59,523 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(310): Store=68acde32baeae53019d8623f9deb81b3/colfamily11, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,523 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily21 of region 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,524 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily21 2023-07-11 18:47:59,524 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily21 2023-07-11 18:47:59,524 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68acde32baeae53019d8623f9deb81b3 columnFamilyName colfamily21 2023-07-11 18:47:59,524 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(310): Store=68acde32baeae53019d8623f9deb81b3/colfamily21, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,525 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=false, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family colfamily31 of region 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,525 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily31 2023-07-11 18:47:59,525 DEBUG [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily31 2023-07-11 18:47:59,526 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68acde32baeae53019d8623f9deb81b3 columnFamilyName colfamily31 2023-07-11 18:47:59,526 INFO [StoreOpener-68acde32baeae53019d8623f9deb81b3-1] regionserver.HStore(310): Store=68acde32baeae53019d8623f9deb81b3/colfamily31, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 18:47:59,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testSplitWithRegionReplicas descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0 M)) instead. 2023-07-11 18:47:59,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:47:59,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 68acde32baeae53019d8623f9deb81b3; next sequenceid=12; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74973179, jitterRate=0.11718742549419403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=33554432} 2023-07-11 18:47:59,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 68acde32baeae53019d8623f9deb81b3: 2023-07-11 18:47:59,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3., pid=216, masterSystemTime=1689101279478 2023-07-11 18:47:59,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.,because compaction is disabled. 2023-07-11 18:47:59,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3. 2023-07-11 18:47:59,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3. 2023-07-11 18:47:59,534 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=210 updating hbase:meta row=68acde32baeae53019d8623f9deb81b3, regionState=OPEN, openSeqNum=12, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:47:59,534 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101279534"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689101279534"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689101279534"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689101279534"}]},"ts":"1689101279534"} 2023-07-11 18:47:59,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=216, resume processing ppid=210 2023-07-11 18:47:59,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=216, ppid=210, state=SUCCESS; OpenRegionProcedure 68acde32baeae53019d8623f9deb81b3, server=jenkins-hbase9.apache.org,40505,1689101231800 in 208 msec 2023-07-11 18:47:59,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=210, resume processing ppid=205 2023-07-11 18:47:59,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=210, ppid=205, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=68acde32baeae53019d8623f9deb81b3, ASSIGN in 365 msec 2023-07-11 18:47:59,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=205, state=SUCCESS; SplitTableRegionProcedure table=testSplitWithRegionReplicas, parent=1ca22a42d7d4b020624695bead405f51, daughterA=68acde32baeae53019d8623f9deb81b3, daughterB=d5d18c65141b22d5e3aacc360fc9aeb2 in 594 msec 2023-07-11 18:47:59,695 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(794): NEWREGION {ENCODED => 7997fb810a9b8c01fb0f4febf4dbe180, NAME => 'testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180.', STARTKEY => 'row2', ENDKEY => '', REPLICA_ID => 1} 2023-07-11 18:47:59,695 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(794): NEWREGION {ENCODED => d5d18c65141b22d5e3aacc360fc9aeb2, NAME => 'testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.', STARTKEY => 'row2', ENDKEY => ''} 2023-07-11 18:47:59,695 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(794): NEWREGION {ENCODED => 68acde32baeae53019d8623f9deb81b3, NAME => 'testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.', STARTKEY => '', ENDKEY => 'row2'} 2023-07-11 18:47:59,695 DEBUG [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(794): NEWREGION {ENCODED => bfa49f88ac100cd2382e0c620b7a7ec3, NAME => 'testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3.', STARTKEY => '', ENDKEY => 'row2', REPLICA_ID => 1} 2023-07-11 18:48:00,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] ipc.CallRunner(144): callId: 317 service: ClientService methodName: Get size: 126 connection: 172.31.2.10:53170 deadline: 1689101340697, exception=org.apache.hadoop.hbase.NotServingRegionException: testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51. is not online on jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:48:00,752 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro 2023-07-11 18:48:00,752 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro Metrics about HBase RegionObservers 2023-07-11 18:48:00,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.client.TestReplicasClient timeout: 13 mins 2023-07-11 18:48:00,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/hadoop.log.dir so I do NOT create it in target/test-data/957f9b3b-dde9-e979-9490-9a30db185066 2023-07-11 18:48:00,813 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/hadoop.log.dir Erasing configuration value by system value. 2023-07-11 18:48:00,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/hadoop.tmp.dir so I do NOT create it in target/test-data/957f9b3b-dde9-e979-9490-9a30db185066 2023-07-11 18:48:00,813 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/hadoop.tmp.dir Erasing configuration value by system value. 2023-07-11 18:48:00,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/957f9b3b-dde9-e979-9490-9a30db185066 2023-07-11 18:48:00,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] client.TestReplicasClient$SlowMeCopro(162): We're the primary replicas. 2023-07-11 18:48:00,814 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(811): exists stale after flush done 2023-07-11 18:48:00,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] client.TestReplicasClient$SlowMeCopro(162): We're the primary replicas. 2023-07-11 18:48:00,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40505] client.TestReplicasClient$SlowMeCopro(169): Waiting for the counterCountDownLatch 2023-07-11 18:48:00,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33849] client.TestReplicasClient$SlowMeCopro(179): We're not the primary replicas. 2023-07-11 18:48:00,835 DEBUG [RPCClient-NioEventLoopGroup-6-12] ipc.NettyRpcDuplexHandler(156): Unknown callId: 322, skipping over this response of 40 bytes 2023-07-11 18:48:00,836 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/balancer 2023-07-11 18:48:00,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(492): Client=jenkins//172.31.2.10 set balanceSwitch=true 2023-07-11 18:48:00,838 INFO [Listener at localhost/44535] regionserver.TestSplitTransactionOnCluster(174): Tear down, remove table=testSplitWithRegionReplicas 2023-07-11 18:48:00,838 INFO [Listener at localhost/44535] client.HBaseAdmin$15(890): Started disable of testSplitWithRegionReplicas 2023-07-11 18:48:00,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testSplitWithRegionReplicas 2023-07-11 18:48:00,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=218, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testSplitWithRegionReplicas 2023-07-11 18:48:00,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=218 2023-07-11 18:48:00,842 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitWithRegionReplicas","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101280842"}]},"ts":"1689101280842"} 2023-07-11 18:48:00,843 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testSplitWithRegionReplicas, state=DISABLING in hbase:meta 2023-07-11 18:48:00,845 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testSplitWithRegionReplicas to state=DISABLING 2023-07-11 18:48:00,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=219, ppid=218, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=68acde32baeae53019d8623f9deb81b3, UNASSIGN}, {pid=220, ppid=218, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=bfa49f88ac100cd2382e0c620b7a7ec3, UNASSIGN}, {pid=221, ppid=218, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=d5d18c65141b22d5e3aacc360fc9aeb2, UNASSIGN}, {pid=222, ppid=218, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=7997fb810a9b8c01fb0f4febf4dbe180, UNASSIGN}] 2023-07-11 18:48:00,846 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=221, ppid=218, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=d5d18c65141b22d5e3aacc360fc9aeb2, UNASSIGN 2023-07-11 18:48:00,846 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=219, ppid=218, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=68acde32baeae53019d8623f9deb81b3, UNASSIGN 2023-07-11 18:48:00,846 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=222, ppid=218, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=7997fb810a9b8c01fb0f4febf4dbe180, UNASSIGN 2023-07-11 18:48:00,846 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=220, ppid=218, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=bfa49f88ac100cd2382e0c620b7a7ec3, UNASSIGN 2023-07-11 18:48:00,847 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=221 updating hbase:meta row=d5d18c65141b22d5e3aacc360fc9aeb2, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:48:00,847 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=219 updating hbase:meta row=68acde32baeae53019d8623f9deb81b3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:48:00,847 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101280847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101280847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101280847"}]},"ts":"1689101280847"} 2023-07-11 18:48:00,847 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101280847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689101280847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689101280847"}]},"ts":"1689101280847"} 2023-07-11 18:48:00,847 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=220 updating hbase:meta row=bfa49f88ac100cd2382e0c620b7a7ec3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:48:00,847 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=222 updating hbase:meta row=7997fb810a9b8c01fb0f4febf4dbe180, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:48:00,847 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101280847"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689101280847"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689101280847"}]},"ts":"1689101280847"} 2023-07-11 18:48:00,847 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101280847"},{"qualifier":"sn_0001","vlen":45,"tag":[],"timestamp":"1689101280847"},{"qualifier":"state_0001","vlen":7,"tag":[],"timestamp":"1689101280847"}]},"ts":"1689101280847"} 2023-07-11 18:48:00,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=223, ppid=221, state=RUNNABLE; CloseRegionProcedure d5d18c65141b22d5e3aacc360fc9aeb2, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:48:00,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=224, ppid=219, state=RUNNABLE; CloseRegionProcedure 68acde32baeae53019d8623f9deb81b3, server=jenkins-hbase9.apache.org,40505,1689101231800}] 2023-07-11 18:48:00,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=225, ppid=220, state=RUNNABLE; CloseRegionProcedure bfa49f88ac100cd2382e0c620b7a7ec3, server=jenkins-hbase9.apache.org,33849,1689101240752}] 2023-07-11 18:48:00,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=226, ppid=222, state=RUNNABLE; CloseRegionProcedure 7997fb810a9b8c01fb0f4febf4dbe180, server=jenkins-hbase9.apache.org,34803,1689101231723}] 2023-07-11 18:48:00,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=218 2023-07-11 18:48:00,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:48:01,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 68acde32baeae53019d8623f9deb81b3, disabling compactions & flushes 2023-07-11 18:48:01,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3. 2023-07-11 18:48:01,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3. 2023-07-11 18:48:01,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3. after waiting 0 ms 2023-07-11 18:48:01,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3. 2023-07-11 18:48:01,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:48:01,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:48:01,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing bfa49f88ac100cd2382e0c620b7a7ec3, disabling compactions & flushes 2023-07-11 18:48:01,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3. 2023-07-11 18:48:01,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7997fb810a9b8c01fb0f4febf4dbe180, disabling compactions & flushes 2023-07-11 18:48:01,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3. 2023-07-11 18:48:01,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180. 2023-07-11 18:48:01,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180. 2023-07-11 18:48:01,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3. after waiting 0 ms 2023-07-11 18:48:01,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180. after waiting 0 ms 2023-07-11 18:48:01,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180. 2023-07-11 18:48:01,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3. 2023-07-11 18:48:01,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro 2023-07-11 18:48:01,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180. 2023-07-11 18:48:01,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro 2023-07-11 18:48:01,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7997fb810a9b8c01fb0f4febf4dbe180: 2023-07-11 18:48:01,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3. 2023-07-11 18:48:01,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for bfa49f88ac100cd2382e0c620b7a7ec3: 2023-07-11 18:48:01,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 7997fb810a9b8c01fb0f4febf4dbe180 2023-07-11 18:48:01,006 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=222 updating hbase:meta row=7997fb810a9b8c01fb0f4febf4dbe180, regionState=CLOSED 2023-07-11 18:48:01,006 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101281006"},{"qualifier":"state_0001","vlen":6,"tag":[],"timestamp":"1689101281006"}]},"ts":"1689101281006"} 2023-07-11 18:48:01,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed bfa49f88ac100cd2382e0c620b7a7ec3 2023-07-11 18:48:01,007 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=220 updating hbase:meta row=bfa49f88ac100cd2382e0c620b7a7ec3, regionState=CLOSED 2023-07-11 18:48:01,007 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101281006"},{"qualifier":"state_0001","vlen":6,"tag":[],"timestamp":"1689101281006"}]},"ts":"1689101281006"} 2023-07-11 18:48:01,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/recovered.edits/14.seqid, newMaxSeqId=14, maxSeqId=11 2023-07-11 18:48:01,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro 2023-07-11 18:48:01,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3. 2023-07-11 18:48:01,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 68acde32baeae53019d8623f9deb81b3: 2023-07-11 18:48:01,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=226, resume processing ppid=222 2023-07-11 18:48:01,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=226, ppid=222, state=SUCCESS; CloseRegionProcedure 7997fb810a9b8c01fb0f4febf4dbe180, server=jenkins-hbase9.apache.org,34803,1689101231723 in 158 msec 2023-07-11 18:48:01,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 68acde32baeae53019d8623f9deb81b3 2023-07-11 18:48:01,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=219 updating hbase:meta row=68acde32baeae53019d8623f9deb81b3, regionState=CLOSED 2023-07-11 18:48:01,009 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:48:01,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101281009"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101281009"}]},"ts":"1689101281009"} 2023-07-11 18:48:01,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d5d18c65141b22d5e3aacc360fc9aeb2, disabling compactions & flushes 2023-07-11 18:48:01,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2. 2023-07-11 18:48:01,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2. 2023-07-11 18:48:01,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2. after waiting 0 ms 2023-07-11 18:48:01,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2. 2023-07-11 18:48:01,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=225, resume processing ppid=220 2023-07-11 18:48:01,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=225, ppid=220, state=SUCCESS; CloseRegionProcedure bfa49f88ac100cd2382e0c620b7a7ec3, server=jenkins-hbase9.apache.org,33849,1689101240752 in 159 msec 2023-07-11 18:48:01,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=222, ppid=218, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=7997fb810a9b8c01fb0f4febf4dbe180, UNASSIGN in 164 msec 2023-07-11 18:48:01,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=220, ppid=218, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=bfa49f88ac100cd2382e0c620b7a7ec3, UNASSIGN in 165 msec 2023-07-11 18:48:01,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=224, resume processing ppid=219 2023-07-11 18:48:01,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=224, ppid=219, state=SUCCESS; CloseRegionProcedure 68acde32baeae53019d8623f9deb81b3, server=jenkins-hbase9.apache.org,40505,1689101231800 in 163 msec 2023-07-11 18:48:01,013 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=219, ppid=218, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=68acde32baeae53019d8623f9deb81b3, UNASSIGN in 167 msec 2023-07-11 18:48:01,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/recovered.edits/14.seqid, newMaxSeqId=14, maxSeqId=11 2023-07-11 18:48:01,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.client.TestReplicasClient$SlowMeCopro 2023-07-11 18:48:01,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2. 2023-07-11 18:48:01,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d5d18c65141b22d5e3aacc360fc9aeb2: 2023-07-11 18:48:01,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:48:01,015 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=221 updating hbase:meta row=d5d18c65141b22d5e3aacc360fc9aeb2, regionState=CLOSED 2023-07-11 18:48:01,015 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1689101281015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689101281015"}]},"ts":"1689101281015"} 2023-07-11 18:48:01,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=223, resume processing ppid=221 2023-07-11 18:48:01,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=223, ppid=221, state=SUCCESS; CloseRegionProcedure d5d18c65141b22d5e3aacc360fc9aeb2, server=jenkins-hbase9.apache.org,40505,1689101231800 in 168 msec 2023-07-11 18:48:01,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=221, resume processing ppid=218 2023-07-11 18:48:01,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=221, ppid=218, state=SUCCESS; TransitRegionStateProcedure table=testSplitWithRegionReplicas, region=d5d18c65141b22d5e3aacc360fc9aeb2, UNASSIGN in 172 msec 2023-07-11 18:48:01,019 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testSplitWithRegionReplicas","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689101281019"}]},"ts":"1689101281019"} 2023-07-11 18:48:01,019 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testSplitWithRegionReplicas, state=DISABLED in hbase:meta 2023-07-11 18:48:01,021 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testSplitWithRegionReplicas to state=DISABLED 2023-07-11 18:48:01,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=218, state=SUCCESS; DisableTableProcedure table=testSplitWithRegionReplicas in 183 msec 2023-07-11 18:48:01,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=218 2023-07-11 18:48:01,144 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testSplitWithRegionReplicas, procId: 218 completed 2023-07-11 18:48:01,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testSplitWithRegionReplicas 2023-07-11 18:48:01,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] procedure2.ProcedureExecutor(1029): Stored pid=227, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testSplitWithRegionReplicas 2023-07-11 18:48:01,146 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=227, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testSplitWithRegionReplicas 2023-07-11 18:48:01,147 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=227, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testSplitWithRegionReplicas 2023-07-11 18:48:01,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=227 2023-07-11 18:48:01,151 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51 2023-07-11 18:48:01,151 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:48:01,151 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3 2023-07-11 18:48:01,154 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily11, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily21, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/colfamily31, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/recovered.edits] 2023-07-11 18:48:01,154 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily11, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily21, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/colfamily31, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/recovered.edits] 2023-07-11 18:48:01,154 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily11, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily21, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/colfamily31, FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/recovered.edits] 2023-07-11 18:48:01,159 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf/5fc6a689da0e437dacabcff06f97181d.1ca22a42d7d4b020624695bead405f51 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/cf/5fc6a689da0e437dacabcff06f97181d.1ca22a42d7d4b020624695bead405f51 2023-07-11 18:48:01,159 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/cf/5fc6a689da0e437dacabcff06f97181d 2023-07-11 18:48:01,159 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf/5fc6a689da0e437dacabcff06f97181d.1ca22a42d7d4b020624695bead405f51 to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/cf/5fc6a689da0e437dacabcff06f97181d.1ca22a42d7d4b020624695bead405f51 2023-07-11 18:48:01,166 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/recovered.edits/14.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2/recovered.edits/14.seqid 2023-07-11 18:48:01,166 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/recovered.edits/14.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3/recovered.edits/14.seqid 2023-07-11 18:48:01,166 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/recovered.edits/11.seqid to hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/archive/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51/recovered.edits/11.seqid 2023-07-11 18:48:01,167 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/d5d18c65141b22d5e3aacc360fc9aeb2 2023-07-11 18:48:01,167 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/68acde32baeae53019d8623f9deb81b3 2023-07-11 18:48:01,167 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/.tmp/data/default/testSplitWithRegionReplicas/1ca22a42d7d4b020624695bead405f51 2023-07-11 18:48:01,167 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testSplitWithRegionReplicas regions 2023-07-11 18:48:01,169 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=227, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testSplitWithRegionReplicas 2023-07-11 18:48:01,171 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 3 rows of testSplitWithRegionReplicas from hbase:meta 2023-07-11 18:48:01,173 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testSplitWithRegionReplicas' descriptor. 2023-07-11 18:48:01,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=227, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testSplitWithRegionReplicas 2023-07-11 18:48:01,174 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testSplitWithRegionReplicas' from region states. 2023-07-11 18:48:01,174 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101281174"}]},"ts":"9223372036854775807"} 2023-07-11 18:48:01,174 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101281174"}]},"ts":"9223372036854775807"} 2023-07-11 18:48:01,174 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101281174"}]},"ts":"9223372036854775807"} 2023-07-11 18:48:01,174 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101281174"}]},"ts":"9223372036854775807"} 2023-07-11 18:48:01,175 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689101281174"}]},"ts":"9223372036854775807"} 2023-07-11 18:48:01,176 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 5 regions from META 2023-07-11 18:48:01,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1ca22a42d7d4b020624695bead405f51, NAME => 'testSplitWithRegionReplicas,,1689101278150.1ca22a42d7d4b020624695bead405f51.', STARTKEY => '', ENDKEY => ''}, {ENCODED => 68acde32baeae53019d8623f9deb81b3, NAME => 'testSplitWithRegionReplicas,,1689101278944.68acde32baeae53019d8623f9deb81b3.', STARTKEY => '', ENDKEY => 'row2'}, {ENCODED => bfa49f88ac100cd2382e0c620b7a7ec3, NAME => 'testSplitWithRegionReplicas,,1689101278944_0001.bfa49f88ac100cd2382e0c620b7a7ec3.', STARTKEY => '', ENDKEY => 'row2', REPLICA_ID => 1}, {ENCODED => d5d18c65141b22d5e3aacc360fc9aeb2, NAME => 'testSplitWithRegionReplicas,row2,1689101278944.d5d18c65141b22d5e3aacc360fc9aeb2.', STARTKEY => 'row2', ENDKEY => ''}, {ENCODED => 7997fb810a9b8c01fb0f4febf4dbe180, NAME => 'testSplitWithRegionReplicas,row2,1689101278944_0001.7997fb810a9b8c01fb0f4febf4dbe180.', STARTKEY => 'row2', ENDKEY => '', REPLICA_ID => 1}] 2023-07-11 18:48:01,176 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testSplitWithRegionReplicas' as deleted. 2023-07-11 18:48:01,176 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testSplitWithRegionReplicas","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689101281176"}]},"ts":"9223372036854775807"} 2023-07-11 18:48:01,178 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testSplitWithRegionReplicas state from META 2023-07-11 18:48:01,179 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=227, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testSplitWithRegionReplicas 2023-07-11 18:48:01,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=227, state=SUCCESS; DeleteTableProcedure table=testSplitWithRegionReplicas in 35 msec 2023-07-11 18:48:01,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36851] master.MasterRpcServices(1230): Checking to see if procedure is done pid=227 2023-07-11 18:48:01,248 INFO [Listener at localhost/44535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testSplitWithRegionReplicas, procId: 227 completed 2023-07-11 18:48:01,263 INFO [Listener at localhost/44535] hbase.ResourceChecker(175): after: regionserver.TestSplitTransactionOnCluster#testSplitWithRegionReplicas Thread=439 (was 419) - Thread LEAK? -, OpenFileDescriptor=780 (was 752) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 181), ProcessCount=170 (was 170), AvailableMemoryMB=7557 (was 7562) 2023-07-11 18:48:01,263 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 18:48:01,263 INFO [Listener at localhost/44535] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 18:48:01,264 DEBUG [Listener at localhost/44535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x744bf7a0 to 127.0.0.1:62848 2023-07-11 18:48:01,264 DEBUG [Listener at localhost/44535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,264 DEBUG [Listener at localhost/44535] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 18:48:01,264 DEBUG [Listener at localhost/44535] util.JVMClusterUtil(257): Found active master hash=1840667423, stopped=false 2023-07-11 18:48:01,264 INFO [Listener at localhost/44535] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:48:01,267 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 18:48:01,267 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 18:48:01,267 INFO [Listener at localhost/44535] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 18:48:01,267 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 18:48:01,267 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:48:01,267 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 18:48:01,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:48:01,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:48:01,268 DEBUG [Listener at localhost/44535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6352e726 to 127.0.0.1:62848 2023-07-11 18:48:01,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:48:01,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 18:48:01,268 DEBUG [Listener at localhost/44535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,268 INFO [Listener at localhost/44535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,34803,1689101231723' ***** 2023-07-11 18:48:01,268 INFO [Listener at localhost/44535] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 18:48:01,268 INFO [Listener at localhost/44535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,40505,1689101231800' ***** 2023-07-11 18:48:01,268 INFO [Listener at localhost/44535] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 18:48:01,268 INFO [Listener at localhost/44535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,33849,1689101240752' ***** 2023-07-11 18:48:01,268 INFO [Listener at localhost/44535] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 18:48:01,268 INFO [RS:0;jenkins-hbase9:34803] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 18:48:01,268 INFO [RS:0;jenkins-hbase9:34803] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 18:48:01,269 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 18:48:01,269 INFO [RS:0;jenkins-hbase9:34803] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 18:48:01,269 INFO [RS:2;jenkins-hbase9:40505] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 18:48:01,269 INFO [RS:3;jenkins-hbase9:33849] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 18:48:01,269 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 18:48:01,269 INFO [RS:3;jenkins-hbase9:33849] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 18:48:01,269 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 18:48:01,269 INFO [RS:3;jenkins-hbase9:33849] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 18:48:01,269 INFO [RS:2;jenkins-hbase9:40505] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 18:48:01,269 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(3305): Received CLOSE for c3865dd83a85f157967ba62a780042b0 2023-07-11 18:48:01,269 INFO [RS:2;jenkins-hbase9:40505] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 18:48:01,269 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:48:01,269 INFO [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:48:01,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c3865dd83a85f157967ba62a780042b0, disabling compactions & flushes 2023-07-11 18:48:01,269 DEBUG [RS:3;jenkins-hbase9:33849] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b4b133b to 127.0.0.1:62848 2023-07-11 18:48:01,269 DEBUG [RS:0;jenkins-hbase9:34803] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5366d7eb to 127.0.0.1:62848 2023-07-11 18:48:01,269 INFO [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:48:01,269 DEBUG [RS:0;jenkins-hbase9:34803] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,269 DEBUG [RS:2;jenkins-hbase9:40505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x519ed8c2 to 127.0.0.1:62848 2023-07-11 18:48:01,269 INFO [RS:0;jenkins-hbase9:34803] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 18:48:01,269 DEBUG [RS:3;jenkins-hbase9:33849] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:48:01,270 INFO [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,33849,1689101240752; all regions closed. 2023-07-11 18:48:01,270 INFO [RS:0;jenkins-hbase9:34803] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 18:48:01,270 DEBUG [RS:2;jenkins-hbase9:40505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,270 INFO [RS:0;jenkins-hbase9:34803] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 18:48:01,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:48:01,270 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 18:48:01,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. after waiting 0 ms 2023-07-11 18:48:01,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:48:01,270 INFO [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,40505,1689101231800; all regions closed. 2023-07-11 18:48:01,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing c3865dd83a85f157967ba62a780042b0 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 18:48:01,270 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-11 18:48:01,270 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1478): Online Regions={c3865dd83a85f157967ba62a780042b0=hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0., 1588230740=hbase:meta,,1.1588230740} 2023-07-11 18:48:01,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 18:48:01,270 DEBUG [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1504): Waiting on 1588230740, c3865dd83a85f157967ba62a780042b0 2023-07-11 18:48:01,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 18:48:01,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 18:48:01,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 18:48:01,270 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 18:48:01,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=127.26 KB heapSize=195.55 KB 2023-07-11 18:48:01,276 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:48:01,276 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:48:01,276 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:48:01,281 DEBUG [RS:2;jenkins-hbase9:40505] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs 2023-07-11 18:48:01,281 INFO [RS:2;jenkins-hbase9:40505] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40505%2C1689101231800:(num 1689101233268) 2023-07-11 18:48:01,281 DEBUG [RS:2;jenkins-hbase9:40505] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,281 INFO [RS:2;jenkins-hbase9:40505] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:48:01,281 INFO [RS:2;jenkins-hbase9:40505] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 18:48:01,282 INFO [RS:2;jenkins-hbase9:40505] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 18:48:01,282 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:48:01,282 INFO [RS:2;jenkins-hbase9:40505] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 18:48:01,282 INFO [RS:2;jenkins-hbase9:40505] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 18:48:01,283 INFO [RS:2;jenkins-hbase9:40505] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:40505 2023-07-11 18:48:01,284 DEBUG [RS:3;jenkins-hbase9:33849] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs 2023-07-11 18:48:01,284 INFO [RS:3;jenkins-hbase9:33849] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C33849%2C1689101240752:(num 1689101240946) 2023-07-11 18:48:01,284 DEBUG [RS:3;jenkins-hbase9:33849] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,284 INFO [RS:3;jenkins-hbase9:33849] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:48:01,284 INFO [RS:3;jenkins-hbase9:33849] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 18:48:01,284 INFO [RS:3;jenkins-hbase9:33849] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 18:48:01,284 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:48:01,284 INFO [RS:3;jenkins-hbase9:33849] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 18:48:01,284 INFO [RS:3;jenkins-hbase9:33849] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 18:48:01,285 INFO [RS:3;jenkins-hbase9:33849] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:33849 2023-07-11 18:48:01,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:48:01,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:48:01,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:48:01,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:48:01,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,40505,1689101231800 2023-07-11 18:48:01,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:48:01,286 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:48:01,287 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:48:01,287 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:48:01,288 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,33849,1689101240752 2023-07-11 18:48:01,289 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,40505,1689101231800] 2023-07-11 18:48:01,292 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,40505,1689101231800; numProcessing=1 2023-07-11 18:48:01,294 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,40505,1689101231800 already deleted, retry=false 2023-07-11 18:48:01,294 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,40505,1689101231800 expired; onlineServers=2 2023-07-11 18:48:01,294 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,33849,1689101240752] 2023-07-11 18:48:01,294 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,33849,1689101240752; numProcessing=2 2023-07-11 18:48:01,295 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,33849,1689101240752 already deleted, retry=false 2023-07-11 18:48:01,295 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,33849,1689101240752 expired; onlineServers=1 2023-07-11 18:48:01,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/.tmp/info/7f9678ff02d64debbacab42991944a13 2023-07-11 18:48:01,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/.tmp/info/7f9678ff02d64debbacab42991944a13 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/info/7f9678ff02d64debbacab42991944a13 2023-07-11 18:48:01,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/info/7f9678ff02d64debbacab42991944a13, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 18:48:01,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c3865dd83a85f157967ba62a780042b0 in 44ms, sequenceid=6, compaction requested=false 2023-07-11 18:48:01,318 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115.86 KB at sequenceid=286 (bloomFilter=false), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/.tmp/info/1e391ef76136438ea7d782e4c4f145ba 2023-07-11 18:48:01,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/namespace/c3865dd83a85f157967ba62a780042b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 18:48:01,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:48:01,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c3865dd83a85f157967ba62a780042b0: 2023-07-11 18:48:01,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689101233721.c3865dd83a85f157967ba62a780042b0. 2023-07-11 18:48:01,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e391ef76136438ea7d782e4c4f145ba 2023-07-11 18:48:01,332 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.90 KB at sequenceid=286 (bloomFilter=false), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/.tmp/rep_barrier/eb280245012f48f0bbcfdb81c92d7463 2023-07-11 18:48:01,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb280245012f48f0bbcfdb81c92d7463 2023-07-11 18:48:01,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=7.51 KB at sequenceid=286 (bloomFilter=false), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/.tmp/table/88aa1cdf8d844581abef33ec4decc67d 2023-07-11 18:48:01,348 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88aa1cdf8d844581abef33ec4decc67d 2023-07-11 18:48:01,348 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/.tmp/info/1e391ef76136438ea7d782e4c4f145ba as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/info/1e391ef76136438ea7d782e4c4f145ba 2023-07-11 18:48:01,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e391ef76136438ea7d782e4c4f145ba 2023-07-11 18:48:01,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/info/1e391ef76136438ea7d782e4c4f145ba, entries=81, sequenceid=286, filesize=14.1 K 2023-07-11 18:48:01,352 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/.tmp/rep_barrier/eb280245012f48f0bbcfdb81c92d7463 as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/rep_barrier/eb280245012f48f0bbcfdb81c92d7463 2023-07-11 18:48:01,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb280245012f48f0bbcfdb81c92d7463 2023-07-11 18:48:01,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/rep_barrier/eb280245012f48f0bbcfdb81c92d7463, entries=34, sequenceid=286, filesize=9.0 K 2023-07-11 18:48:01,357 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/.tmp/table/88aa1cdf8d844581abef33ec4decc67d as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/table/88aa1cdf8d844581abef33ec4decc67d 2023-07-11 18:48:01,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88aa1cdf8d844581abef33ec4decc67d 2023-07-11 18:48:01,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/table/88aa1cdf8d844581abef33ec4decc67d, entries=47, sequenceid=286, filesize=9.5 K 2023-07-11 18:48:01,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~127.26 KB/130318, heapSize ~195.50 KB/200192, currentSize=0 B/0 for 1588230740 in 91ms, sequenceid=286, compaction requested=false 2023-07-11 18:48:01,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/data/hbase/meta/1588230740/recovered.edits/289.seqid, newMaxSeqId=289, maxSeqId=1 2023-07-11 18:48:01,366 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 18:48:01,367 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 18:48:01,367 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 18:48:01,367 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 18:48:01,466 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:48:01,466 INFO [RS:3;jenkins-hbase9:33849] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,33849,1689101240752; zookeeper connection closed. 2023-07-11 18:48:01,466 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:33849-0x10155a8225f0009, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:48:01,466 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3333fe82] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3333fe82 2023-07-11 18:48:01,470 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,34803,1689101231723; all regions closed. 2023-07-11 18:48:01,475 DEBUG [RS:0;jenkins-hbase9:34803] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs 2023-07-11 18:48:01,475 INFO [RS:0;jenkins-hbase9:34803] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C34803%2C1689101231723.meta:.meta(num 1689101233438) 2023-07-11 18:48:01,481 DEBUG [RS:0;jenkins-hbase9:34803] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/oldWALs 2023-07-11 18:48:01,481 INFO [RS:0;jenkins-hbase9:34803] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C34803%2C1689101231723:(num 1689101233268) 2023-07-11 18:48:01,481 DEBUG [RS:0;jenkins-hbase9:34803] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,481 INFO [RS:0;jenkins-hbase9:34803] regionserver.LeaseManager(133): Closed leases 2023-07-11 18:48:01,481 INFO [RS:0;jenkins-hbase9:34803] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 18:48:01,481 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:48:01,482 INFO [RS:0;jenkins-hbase9:34803] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:34803 2023-07-11 18:48:01,484 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,34803,1689101231723 2023-07-11 18:48:01,484 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 18:48:01,486 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,34803,1689101231723] 2023-07-11 18:48:01,487 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,34803,1689101231723; numProcessing=3 2023-07-11 18:48:01,488 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,34803,1689101231723 already deleted, retry=false 2023-07-11 18:48:01,488 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,34803,1689101231723 expired; onlineServers=0 2023-07-11 18:48:01,488 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,36851,1689101253218' ***** 2023-07-11 18:48:01,488 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 18:48:01,488 DEBUG [M:0;jenkins-hbase9:36851] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6989d271, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-11 18:48:01,489 INFO [M:0;jenkins-hbase9:36851] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,36851,1689101253218 2023-07-11 18:48:01,489 INFO [M:0;jenkins-hbase9:36851] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,36851,1689101253218; all regions closed. 2023-07-11 18:48:01,489 DEBUG [M:0;jenkins-hbase9:36851] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 18:48:01,489 DEBUG [M:0;jenkins-hbase9:36851] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 18:48:01,489 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 18:48:01,489 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101253402] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689101253402,5,FailOnTimeoutGroup] 2023-07-11 18:48:01,489 DEBUG [M:0;jenkins-hbase9:36851] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 18:48:01,489 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101253402] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689101253402,5,FailOnTimeoutGroup] 2023-07-11 18:48:01,489 INFO [M:0;jenkins-hbase9:36851] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 18:48:01,489 INFO [M:0;jenkins-hbase9:36851] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 18:48:01,489 INFO [M:0;jenkins-hbase9:36851] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-11 18:48:01,489 DEBUG [M:0;jenkins-hbase9:36851] master.HMaster(1512): Stopping service threads 2023-07-11 18:48:01,489 INFO [M:0;jenkins-hbase9:36851] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 18:48:01,489 ERROR [M:0;jenkins-hbase9:36851] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-11 18:48:01,489 INFO [M:0;jenkins-hbase9:36851] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 18:48:01,489 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 18:48:01,490 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 18:48:01,490 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 18:48:01,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 18:48:01,490 DEBUG [M:0;jenkins-hbase9:36851] zookeeper.ZKUtil(398): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 18:48:01,490 WARN [M:0;jenkins-hbase9:36851] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 18:48:01,490 INFO [M:0;jenkins-hbase9:36851] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 18:48:01,490 INFO [M:0;jenkins-hbase9:36851] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 18:48:01,491 DEBUG [M:0;jenkins-hbase9:36851] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 18:48:01,491 INFO [M:0;jenkins-hbase9:36851] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:48:01,491 DEBUG [M:0;jenkins-hbase9:36851] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:48:01,491 DEBUG [M:0;jenkins-hbase9:36851] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 18:48:01,491 DEBUG [M:0;jenkins-hbase9:36851] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:48:01,491 INFO [M:0;jenkins-hbase9:36851] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=452.91 KB heapSize=536.16 KB 2023-07-11 18:48:01,502 INFO [M:0;jenkins-hbase9:36851] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=452.91 KB at sequenceid=1739 (bloomFilter=true), to=hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/05fcf2969e26404cbdc4663c142bec3c 2023-07-11 18:48:01,507 DEBUG [M:0;jenkins-hbase9:36851] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/05fcf2969e26404cbdc4663c142bec3c as hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/05fcf2969e26404cbdc4663c142bec3c 2023-07-11 18:48:01,510 INFO [M:0;jenkins-hbase9:36851] regionserver.HStore(1080): Added hdfs://localhost:33811/user/jenkins/test-data/19855a13-6ffe-2db7-9891-a2dc2ff67e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/05fcf2969e26404cbdc4663c142bec3c, entries=124, sequenceid=1739, filesize=23.4 K 2023-07-11 18:48:01,511 INFO [M:0;jenkins-hbase9:36851] regionserver.HRegion(2948): Finished flush of dataSize ~452.91 KB/463777, heapSize ~536.15 KB/549016, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=1739, compaction requested=true 2023-07-11 18:48:01,511 INFO [M:0;jenkins-hbase9:36851] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 18:48:01,512 DEBUG [M:0;jenkins-hbase9:36851] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 18:48:01,515 INFO [M:0;jenkins-hbase9:36851] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 18:48:01,515 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 18:48:01,515 INFO [M:0;jenkins-hbase9:36851] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:36851 2023-07-11 18:48:01,517 DEBUG [M:0;jenkins-hbase9:36851] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,36851,1689101253218 already deleted, retry=false 2023-07-11 18:48:01,566 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:48:01,566 INFO [RS:2;jenkins-hbase9:40505] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,40505,1689101231800; zookeeper connection closed. 2023-07-11 18:48:01,566 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:40505-0x10155a8225f0003, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:48:01,566 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@312fed3e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@312fed3e 2023-07-11 18:48:02,067 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:48:02,067 INFO [M:0;jenkins-hbase9:36851] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,36851,1689101253218; zookeeper connection closed. 2023-07-11 18:48:02,067 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): master:36851-0x10155a8225f000e, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:48:02,167 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:48:02,168 INFO [RS:0;jenkins-hbase9:34803] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,34803,1689101231723; zookeeper connection closed. 2023-07-11 18:48:02,168 DEBUG [Listener at localhost/44535-EventThread] zookeeper.ZKWatcher(600): regionserver:34803-0x10155a8225f0001, quorum=127.0.0.1:62848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 18:48:02,168 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@9f01b0b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@9f01b0b 2023-07-11 18:48:02,168 INFO [Listener at localhost/44535] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 4 regionserver(s) complete 2023-07-11 18:48:02,169 WARN [Listener at localhost/44535] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 18:48:02,171 INFO [Listener at localhost/44535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 18:48:02,275 WARN [BP-1159175942-172.31.2.10-1689101227463 heartbeating to localhost/127.0.0.1:33811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 18:48:02,275 WARN [BP-1159175942-172.31.2.10-1689101227463 heartbeating to localhost/127.0.0.1:33811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1159175942-172.31.2.10-1689101227463 (Datanode Uuid 7cc0be33-cc44-404f-8ecd-5eadfc2b4104) service to localhost/127.0.0.1:33811 2023-07-11 18:48:02,277 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data5/current/BP-1159175942-172.31.2.10-1689101227463] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:48:02,277 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data6/current/BP-1159175942-172.31.2.10-1689101227463] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:48:02,279 WARN [Listener at localhost/44535] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 18:48:02,280 INFO [Listener at localhost/44535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 18:48:02,385 WARN [BP-1159175942-172.31.2.10-1689101227463 heartbeating to localhost/127.0.0.1:33811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 18:48:02,385 WARN [BP-1159175942-172.31.2.10-1689101227463 heartbeating to localhost/127.0.0.1:33811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1159175942-172.31.2.10-1689101227463 (Datanode Uuid 20c2cda4-3fcf-4c8e-8e4d-6eea3115324d) service to localhost/127.0.0.1:33811 2023-07-11 18:48:02,386 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data3/current/BP-1159175942-172.31.2.10-1689101227463] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:48:02,386 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data4/current/BP-1159175942-172.31.2.10-1689101227463] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:48:02,387 WARN [Listener at localhost/44535] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 18:48:02,393 INFO [Listener at localhost/44535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 18:48:02,498 WARN [BP-1159175942-172.31.2.10-1689101227463 heartbeating to localhost/127.0.0.1:33811] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 18:48:02,498 WARN [BP-1159175942-172.31.2.10-1689101227463 heartbeating to localhost/127.0.0.1:33811] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1159175942-172.31.2.10-1689101227463 (Datanode Uuid 3a096449-0f61-4377-89b3-70f938da5e7e) service to localhost/127.0.0.1:33811 2023-07-11 18:48:02,498 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data1/current/BP-1159175942-172.31.2.10-1689101227463] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:48:02,499 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fa5a3477-a4e5-56cb-1419-73cad87d0ec0/cluster_b89bd234-889c-10d3-d391-ddac44cb195d/dfs/data/data2/current/BP-1159175942-172.31.2.10-1689101227463] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 18:48:02,520 INFO [Listener at localhost/44535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 18:48:02,652 INFO [Listener at localhost/44535] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 18:48:02,739 INFO [Listener at localhost/44535] hbase.HBaseTestingUtility(1293): Minicluster is down